How to Survive a Verification Part 3: Verification Testing

April 18, 2022
15 min
How to Survive a Verification Part 3: Verification Testing

This article is part three of a three-part series on how to survive a GIPS verification. If you haven’t had a chance to read parts one and two, we recommend reading those first. The first part covers tips and tricks for setting up your verification for success. The second part covers recommendations for kicking off the verification and provides context about the initial data requests made by the verifier.

In this article, we describe how to get through the actual verification testing, which tends to be the most time-consuming aspect of a GIPS verification. Specifically, we discuss how the testing sample is determined and then dive into the details of each major testing area. Plus, we include advice to help you determine what to provide to satisfy the verifier’s requests.

How the Testing Sample is Determined

The end goal of verification is the opinion letter that attests to “whether the firm's policies and procedures related to composite and pooled fund maintenance, as well as the calculation, presentation, and distribution of performance, have been designed in compliance with the GIPS standards and have been implemented on a firm-wide basis.”

At this stage, the verifier has already reviewed your firm’s GIPS policies and procedures and likely confirmed that they have been adequately designed. The focus now is on whether these policies have “been implemented on a firm-wide basis.”

To test this, a sample must be selected. The size of the sample depends primarily on three things:

  1. The number of portfolios managed
  2. The number of composites maintained  
  3. The verifier’s risk assessment of your firm

If you have had many errors in prior verifications or if your initial data provided to kick-off the verification had errors, the risk assessment will be high and the sample selection will likely be larger than average.

With that in mind, it is always a good idea to do your own review of your firm’s policies and procedures and data prior to providing anything to the verification firm. Even if issues were identified in the past, starting this pre-review now can help the current verification go faster and with less errors, potentially lowering the risk assessment and sample size for future verification periods.

What to expect with the Verification Testing Request

All verification firms are different in how they structure their testing process. They may have different names for the types of testing they do, but the main purpose is the same. The most typical types of testing include:

  • Membership Testing
    • Entry Testing
    • Exit Testing
    • Outlier Testing
  • Non-Discretionary Testing
  • Return and Market Value Testing

Before diving into pulling and providing the requested documents, it is important to review the full request to ensure you are clear on what the verifier is trying to confirm. When not sure what to provide, it may be helpful to have a call with the verifier to discuss what is available. Knowing exactly what the verifier is trying to prove out makes it much easier to provide meaningful support. Blindly providing documents that may not tell the full story of what’s happening with the selected portfolio may lead to more questions/follow up.

Keep in mind that, the verifier prefers reviewing the most independent information available. For example, a contract signed by the client is typically preferred over an internal memo, but signed documentation from the client is not always available. To give you an idea of how to determine what to provide, below is a hierarchy of the preferred support:

  1. Dated Correspondence Written or Signed by Client that Supports the Selected Testing Item
    • Contract and/or investment guidelines
    • Signed Investment Policy Statement
    • Termination letter
    • Email written by the client
  2. Dated Notes Written by your Firm at the Time the Selected Testing Item Occurred
    • Email from your firm to the client
    • Email sent internally documenting the issue selected for testing
    • CRM notes written by your firm
    • Memo written by your firm saved to the client’s file
  3. Written Explanation Created by Your Firm Now
    • A memo can be written now documenting support for the selected testing item. This is only acceptable if the person writing the memo has knowledge of the issue that can be documented to support the testing (e.g., a recollection of a verbal request from the client that was never documented) and if the other items above are not available. This should only be used in rare occasions as a last resort.

The following sections discuss each of the most common testing areas in more detail.

The purpose of membership testing is to confirm that portfolios are included in the correct composite for the correct time period, as determined by your firm’s GIPS policies and procedures. It is important to remember that any movement in and out of composites should always tie back to policies outlined in your firm’s GIPS policies and procedures and should not be made based on discretionary changes to a portfolio made by the portfolio manager. For the GIPS standards, the consistent application of policies is key!

Membership Testing

Entry Testing

The purpose of entry testing is to confirm that your firm has consistently followed your stated membership policies and procedures for including portfolios in composites. The verifier’s testing approach is adjusted to match your documented policies and procedures for portfolios entering a composite. Portfolio inclusion is typically triggered due to one of the following reasons:

  1. New portfolio opened
  2. Portfolio increased in size and now meets the minimum asset level of the composite
  3. Material restriction was removed from the portfolio
  4. Re-inclusion of a portfolio following a significant cash flow

When pulling supporting documents for the verifier, it is important to consider the reason the portfolio entered (or re-entered) the composite. When providing supporting documents, make sure the documents demonstrate the reason for inclusion and provide additional written commentary when necessary to help the verifier gain a full understanding of the situation. This will speed up the verification process as it will cut down on the need for follow-up questions.

In testing that your firm has consistently followed your stated membership policies and procedures for including portfolios in composites, the verifier is primarily focused on the timing and placement of portfolios entering a composite. Testing timing involves the verifier confirming your stated policy is being followed in terms of when the portfolio should enter the composite. Testing placement involves the verifier confirming that the portfolio is added to a composite that aligns with the portfolio’s investment objective.

To confirm the timing of a new portfolio’s inclusion, the verifier typically requests several documents, most commonly the account’s transaction summary and contract. The transaction summary provides information about when the new portfolio was funded, and when the portfolio manager started investing in discretionary assets. The contract is used to assess when the discretionary contract was signed by your client and ensure the timeline makes sense.

Placement can be a bit more complicated in terms of support. The verifier typically requests several standard documents to support the placement. This is not an all-inclusive list, but items requested to support placement can include contracts, investment policy statements, portfolio holdings, fee schedules, client correspondence, CRM system notes, and/or internal memos.

Exit Testing

Opposite of entry testing, exit testing is the verifier’s testing of portfolios that leave a composite. Before diving into the documents your verifier may request, it’s best to figure out why the selected portfolio is exiting the composite. This background knowledge will help you focus on the type of documentation to provide your verifier.

Because portfolios selected for exit testing are not joining a composite, there is no placement considerations in this testing like there is for entry testing. Therefore, exit testing focuses on the timing of a portfolio’s removal from the composite and ensuring the reason for removal is valid. Whether the account lost discretion, terminated, changed its mandate, or violated a composite-specific policy, the verifier will be looking to test the timing of the event.

The most common types of documentation that can support the removal include updated contracts, client correspondence, internal memos, and transaction summaries. The transaction summary will show the true timing of the change to the portfolio, but when discretion is lost or a mandate is changed the verifier will also be looking for support that this change was client driven, which cannot be supported by a transaction summary alone.

It is important to note that unless a composite is redefined or a composite policy is broken (such as the portfolio dropping below a minimum asset level) any movement of portfolios in or out of composites must be client-driven. That is, support for a portfolio exiting a composite should include documentation of a client requesting to terminate management, change the strategy, or add some kind of material restriction.

For example, a client request to hold high levels of cash because of declining market conditions may be a reason to remove the portfolio from the composite, if holding such cash moves the account to non-discretionary status (as outlined in your GIPS policies & procedures). Alternatively, if a portfolio manager used their discretion to deviate from the documented composite description (e.g., holding higher cash levels than described in its strategy due to adverse market conditions), this is not considered a valid reason to remove a portfolio from the composite.

Another form of membership testing is outlier testing. In this analysis, instead of evaluating the movement of portfolios in or out of a composite, the verifier assesses portfolios with performance that deviates from its peers. The purpose of this testing is to confirm that the portfolio is correctly included in the composite, despite the difference in performance.

Outlier Testing

Performance deviations can happen for several reasons and are not necessarily a problem. For example, the following are a handful of common reasons for performance deviations:

  1. A portfolio may have a large cash flow causing a temporary deviation. This is especially true for composites that do not have a significant cash flow policy
  2. A portfolio may contain different holdings than others in the composite, despite having the same objective
  3. Sometimes smaller portfolios may be more concentrated than larger portfolios (most commonly seen when the composite does not have a minimum asset level)
  4. A portfolio may be subject to client-mandated restrictions that the firm has deemed immaterial to the implementation of the strategy

The verifier will want to gain comfort that the investment mandate for the portfolio is in line with the composite strategy, any client-mandated restrictions are not material enough for the portfolio to be considered non-discretionary, and no composite policies have been broken relating to minimum asset levels, significant cash flows, etc. In these situations, an explanation should be provided to the verifier to help them understand why the portfolio belongs in the composite, despite having different performance for the month tested.

Please note that if a portfolio is performing differently than its peers because of a restriction, the verifier will want to confirm that the restriction is client-mandated and that it is not breaking any rules outlined in your firm's definition of discretion within your GIPS policies & procedures. If the restriction is material and breaks your firm’s rules for discretion, then the portfolio should not be in the composite and will need to be removed.

Non-Discretionary Testing

While membership testing focuses on portfolios in (or moving in and out of) composites, non-discretionary testing focuses on confirming that portfolios not in composites have a valid reason to be excluded.

Unless a portfolio is deemed non-discretionary, all fee-paying segregated accounts must be included in a composite. Any account excluded from all composites should have a client-driven reason for the exclusion (e.g., a material restriction or a request for a custom mandate). As mentioned, deviations from the strategy made by the portfolio manager’s discretion are not valid reasons to exclude accounts from composites.

The verifier’s sample of non-discretionary portfolios will come directly from your AUM report or list of non-discretionary portfolios. The verifier is typically looking for non-discretionary portfolios they have never tested (many verification firms track portfolios they have tested in prior years), larger non-discretionary portfolios, and non-discretionary portfolios with unique/different reasons listed for being excluded. Because the list of non-discretionary portfolios is a snap shot in time, it will likely include many exclusion reasons– whether it is a long-term restriction, short-term restriction, or a violation of composite policies like a minimum asset level or a significant cash flow policy.

In addition to providing the reason the portfolio is non-discretionary, common requests from a verifier include contracts, investment policy statements and portfolio holdings reports. Verifiers use contracts and investment policy statements to find any documented restrictions in the paperwork. Often, this is clearly outlined in these onboarding documents, but this is not always the case. If restrictions are not clearly documented in these files, the verifier will likely request CRM notes, email correspondence with the client, and/or an internal memo to document the restriction in place. A portfolio-holdings report typically is used to see if any noted restriction is evident in the holdings and management of the account.

Portfolio-Level Return Testing

There are two main goals of portfolio-level return testing:

  1. Confirmation that the input data used in the calculation can be independently supported
  2. Verification that the calculation methodology outlined in the firm’s GIPS policies and procedures can be applied to the input data to achieve materially the same performance result as your firm

For a firm-wide verification, verifiers will likely have you provide a sample of custodial records in addition to portfolio accounting system reports to gain comfort that the input data used in the performance calculations can be independently supported. If you are having a performance examination on a composite in addition to the firm-wide verification, then this sample will likely be greatly increased.

The verifier uses the portfolio’s custodial statement in conjunction with the corresponding system holdings report and transaction summary to confirm whether market values and transaction activity, including trades, cash flows, fees and expenses, match between the two documents. If there are differences in the timing or amounts of transactions, the verifier will likely have follow-up questions to gain and understanding as to why such differences exist. Lastly, the custodial statement can also be used to confirm whether the portfolio is paying commissions on a per-trade basis.

The portfolio’s fee schedule may also be requested. If the composite calculates net-of-fee returns using actual investment management fees, the verifier will look at the portfolio’s gross and net-of-fee returns to ensure they are in line with the portfolio’s fee schedule. If the spread between gross- and net-of-fee returns does not reconcile with the fee schedule, there will be follow-up questions to figure out why the difference exists and if there are any other fees/expenses impacting the returns that need to be considered.

If your composite net-of-fee returns are calculated with model fees, the verifier will compare the provided fee schedule against the applied model fee. If the model fee is higher than the provided fee schedule, there will likely be no further questions. However, if the fee schedule is higher than the applied model fee, the verifier will likely need to do some alternative testing to ensure that the model fee applied is appropriate.

Once the input data is validated, the verifier will apply the calculation methodology outlined in your firm’s GIPS policies and procedures to confirm they can achieve materially the same performance results. Specifically, the verifier is looking at the treatment of external cash flows, fees, withholdings tax, and interest and dividend accruals to ensure the treatment of each meets the requirements of the GIPS standards and matches your firm’s policies and procedures.

If the verifier is unable to recalculate the returns following the methodology outlined in your GIPS policies and procedures and you believe the timing and amount of all transactions are consistent between your system and what the verifier is using, you should double check that your policies accurately describe your current system settings. For example, have you accurately documented whether external cash flows are accounted for as of the beginning of day or end of day, whether dividends are accounted for as of ex-date or payment date, whether performance is reduced by withholdings taxes, what size cash flows trigger revaluation, or any other settings that could trigger a difference in the performance calculation?

This is an important part of the verification testing as it confirms that an appropriate calculation methodology, acceptable under the requirements of the GIPS standards, has been consistently applied to the portfolios across your firm. Any material differences identified in this testing will need to be resolved before the verification can be completed.

Wrapping up the Verification

Once all testing procedures are complete, most verification firms will conduct their own internal quality control review to ensure the engagement team adequately addressed all testing items before officially signing-off. During this review some additional questions may arise to satisfy the reviewer, but the testing should be materially complete at this point. It is helpful if you can be prepared to answer questions and provide any last-minute document requests in a timely fashion to help move the project across the finish line.

Once all internal reviews have been completed and signed off, the verifier will send a representation letter to your firm. The representation letter is essentially a request for your firm’s attestation that, to the best of your knowledge, everything provided during the verification was accurate and complete. This is a necessary step that all verification firms require you to complete before the verification opinion letter can be issued.

After the representations letter has been attested to by your firm, the opinion letter should be issued shortly thereafter. This wraps up your verification project. Time to celebrate with your team and hopefully enjoy a bit of time away from the verification project before the next annual project begins.

One final recommendation is to have a debrief with your team and any consultants you work with to maintain GIPS compliance. Discuss what went well and what areas held up the verification project. If any areas held up the timeline, this is a good opportunity to consider ways to improve procedures and ongoing composite/data reviews. Planning ahead and implementing improved processes based on what was learned during the verification will help future verifications continue to get smoother over time.

Conclusion

The challenges faced when going through a GIPS verification can vary depending on your firm’s structure/size, the types of products you manage, and the verification firm used. This series was intended to provide a general overview of the most typical verification process and share tips and tricks for helping simplify your verification. If you have questions unique to your verification that we did not cover, please reach out to us to learn more. If you need assistance with a GIPS compliance, Longs Peak is here to help. We have helped hundreds of firms become GIPS complaint and maintain that compliance on an ongoing basis. We are happy to assist your firm with all of its needs relating to the calculation and presentation of investment performance.

You can email matt@longspeakadvisory.com or sean@longpseakadvisory.com with questions or check out our website for more information.

Recommended Post

View All Articles
Key Takeaways from the 30th Annual GIPS® Standards Conference in Philadelphia
Key takeaways from the 30th Annual GIPS® Standards Conference, including AI’s role in investment performance and verification, SEC exam priorities, and proposed trade error guidance.
November 18, 2026
15 min

CFA Institute hosted the 30th Annual Global Investment Performance Standards (GIPS®) Conference on November 10 and 11, 2026 in Philadelphia, Pennsylvania. Thirty years in, the conference still does what it does best, bringing the performance community together to work through the issues that land on our desks. It was good to reconnect with familiar faces and to see many first timers in the room.

‍

The theme was "Shaping What is Next in Investment Performance," and one topic ran through nearly every session, even those not specifically dedicated to it: artificial intelligence. It came up in verification, the SEC discussion, the GIPS Standards update, and across the questions attendees submitted all week. While AI seemed to dominate many of the discussions, other themes included SEC examination priorities, proposed guidance on trade errors, performance-based fee calculations, the retailization of private markets, and the asset owner view of GIPS compliance. Here are the takeaways worth passing along.

‍

AI Took Center Stage

The audience polls reflected both enthusiasm for AI and caution about its use. Seventy-five percent of attendees expect AI and automation to have the greatest impact on verification over the next five years. At the same time, 84% are uncomfortable fully delegating final approval of client communications to AI. Roughly 80% also believe the GIPS standards need little adjustment in response to AI, with only minor tweaks necessary.

‍

CFA Institute's framing seemed reassuring for firms already experimenting. AI is treated as one more tool in the performance process, much like an accounting or performance system. Using it does not, by itself, jeopardize a firm's GIPS compliance. What matters is how firms oversee its use. CFA Institute is researching model bias and ethics to decide whether changes to the standards are needed.

‍

The practical sessions showed how much is already possible, from building efficient frontier analysis and tracking error decomposition to drafting attribution commentary with an AI agent in a fraction of the usual time. The consistent message from presenters was that the human must be in the loop. One speaker summed it up well: delegate tasks, but do not delegate responsibility. Some errors are harder to spot than an obvious hallucination, like when the numbers are right, but the interpretation is wrong. The expectation is a clear chain of evidence behind any result, with a qualified person reviewing it before it goes out.

‍

That logic carried into record keeping. When AI contributes to a calculation, a disclosure, or a GIPS Report, firms should retain enough information to support and recreate the result, as verifiers or regulators may ask for it. In practice that means documenting how AI is used in your policies and procedures, keeping version control over prompts, and retaining the underlying data. The accountability does not transfer to the software.

‍

CFA Institute is gathering industry input through its AI and performance survey. Responses will help inform any future updates to the GIPS standards. If you work in performance, we encourage you to participate.

‍

The GIPS Standards Update: What Is New and What Is Coming

As of October31, 2026, 1,647 organizations across 51 markets claim compliance with the GIPS standards, including all of the top 25 global firms and 85 of the top 100. Adoption remains strongest in the US, UK, Canada, Switzerland, and South Africa, with Saudi Arabia now in the top ten.

‍

The headline project is a proposed Guidance Statement on Trade Errors, out for comment through December 15, 2026. Trade errors happen at every firm, and the proposal addresses how to handle them in portfolios and composites alongside a firm's error correction policy. The key points in the proposed new guidance are that a trade error policy would be optional, much like a significant cash flow policy, while error correction stays mandatory for compliant firms. The guidance would add a narrow new reason a firm may remove a portfolio from a composite. Presenters were clear that this is not a way to drop a poor performer by calling it an error, and that firms would need consistent materiality thresholds. If you have opinions you would like to share about this guidance before it is finalized, please submit your comment letters to gipsstandards@cfainstitute.org by 15 December.

‍

CFA Institute also released a Guide for Return Attribution Reporting and the third edition of its paper Reconciling the GIPS Standards and the SEC Marketing Rule. Further out, a GIPS 2030 consultation paper is taking shape, with net-of-fee presentation, model portfolios, after-tax reporting, and AI all on the list. One idea under consideration would let firms present the net return relevant to a prospect, not only the most conservative net return, which would help align the GIPS standards with the SEC Marketing Rule.

‍

SEC Marketing Rule and the Current State of Exams

Mark Dowdell of the SEC Division of Examinations gave another candid session. The 2027 exam program is squarely retail focused, with attention on fiduciary duties, conflicts of interest, liquidity, complex products, and private credit valuation, along with cybersecurity and AI.

‍

On the Marketing Rule, recent staff guidance has eased two pain points. Firms now have a safe harbor to show investment characteristics and extracted performance on a gross basis, as long as the related composite or total-portfolio gross and net returns appear with equal prominence over the same period and the gross figures are clearly labeled. Firms also have more flexibility to present net performance using actual fees even when those are lower than the anticipated fee, with appropriate disclosure. Also, it was clarified that returns that comply with the SEC Marketing Rule, but do not meet the requirements of the GIPS standards, may be presented as supplemental information for a GIPS compliant firm.

‍

Examination findings continue to highlight familiar weaknesses. Firms are still cited for policies that were never updated for the Marketing Rule and for annual reviews that lack real testing. Hypothetical and predecessor performance remain trouble spots, and examiners continue to check incentive fee calculations against the governing documents. On AI, the message was straightforward: if you use it to help review or sign off on performance, make sure to have policies around it, include human oversight, and create strong supporting documentation, because the staff will ask exactly how the AI tools are used. The SEC also cited firms that exaggerate their use of AI.

‍

Performance-Based Fees: Small Details, Significant Implications

A session on performance-based fees drove home a single point: small differences in contractual language can materially change what a general partner earns. Compounding frequency, catch-up provisions, high-water marks, and the choice between European and American style waterfalls can each swing the result. Whether carried interest is structured as a fee or an allocation of profit can also change its tax implications.

‍

The session emphasized the need for shared understanding of the calculation. Lawyers draft the terms, administrators calculate the fees, and auditors verify the result. The intent, the language, and the calculation all have to agree. Many attendees asked whether any system can handle bespoke fee calculations well or if the work still ends up in Excel. The vast majority still seem to be using Excel for these calculations although there is some shift to software solutions. A pending SEC proposal could extend the use of incentive fees to a broader set of public funds, potentially bringing these challenges to more of the industry.

‍

Private Markets and Retailization

As private markets expand into wealth and retirement channels, the recurring message was that access is only part of the equation. As one panelist put it, private markets are a decision inside plan design, not a decision instead of it.

‍

The harder issue is valuation. In semi-liquid and evergreen vehicles, the net asset value is not just a reporting mark, it is the price at which investors subscribe and redeem. This makes valuation accuracy more important than ever. Appraisal-based values can smooth volatility and delay the recognition of losses, and every private market metric ultimately rests on an estimate of what is still held. The guidance for practitioners was to clearly separate realized cash returns from the manager’s unrealized estimates, disclose smoothing and benchmark limits, and tailor the disclosure to the investor. It was also noted that even when AI supports a valuation model, the valuer remains accountable for the result.

‍

Asset Owner Perspectives

A panel of GIPS compliant asset owners, including the Public Investment Fund of Saudi Arabia, MassPRIM, and the Pennsylvania Treasury, shared why they pursued compliance when no client required it. In each case the decision came from the top and was about institutional excellence and the confidence that independently verified numbers give boards, oversight bodies, and the external managers they hire. One panelist described compliance by osmosis: once the organization commits, the whole team pays closer attention to the inputs that drive performance, and issues get caught before they grow.

‍

A poll showed that most asset owner RFPs now ask whether managers are GIPS compliant, and a growing number ask across all asset classes. This pulls compliance into less transparent parts of the market such as private assets. The panelists were candid about shared challenges, including lagged private market valuations, but were encouraging about the path forward for more asset owners to claim compliance. They noted that compliance is achievable even with a small team when the right custodian, verifier, and consultant are in place.

‍

This is one of the threads we watched most closely. Asset owner adoption raises the bar for everyone, because an asset owner that has done the work expects the same discipline, ethics, and full disclosure from the managers it hires. Helping asset owners and the managers they evaluate meet that standard is a core part of our work, and we expect this community to keep driving demand for GIPS compliance across asset classes.

‍

Final Thoughts

Even with a large focus on artificial intelligence, the message from Philadelphia was that the fundamentals have not changed. AI can improve the speed and quality of performance work, but trustworthy reporting still depends on transparency, consistency, documentation, and human accountability. The firms that come out ahead will treat AI as leverage for their expertise rather than a replacement for it, and keep their policies, records, and review processes a step ahead of the tools.

‍

At Longs Peak, we help firms and asset owners put these principles into practice. We help build practical, well-controlled performance and GIPS compliant processes, from composite construction, performance reporting, and Marketing Rule presentations to preparation for verification. Increasingly, it also includes helping clients document and oversee AI use within those processes. If you would like to talk through how any of these developments affect your organization, please contact us.

‍

GIPS® is a registered trademark owned by CFA Institute. CFA Institute does not endorse or promote this organization, nor does it warrant the accuracy or quality of the content contained herein.

If AI does much of the performance work that taught us,what will teach the next generation of performance experts?

‍

I recently sat in on a webinar with Hope Morrissey of BigPi on building AI tools inside a firm. It was practical and timely: at Longs Peak, we are building out our own workbench, and much of the conversation mapped onto choices we are making right now.

‍

But the question I asked at the end wasn't about tooling. It was about people.

‍

Most of us learned this profession by doing grunt work. We linked monthly returns by hand in Excel. We built and rebuilt composites line by line. We chased a 3 bp difference for an afternoon and found a fee posted to the wrong month. We made mistakes, and someone more experienced caught them and explained why.

‍

That work is going away, and maybe it should. AI and automation increasingly handle reconciliation, first-pass review and draft disclosures faster than any analyst. What's left, and what matters most, is judgment and expertise.

‍

Which raises the uncomfortable part: if the work that built today's experts disappears, how do we build tomorrow's?

‍

The grunt work was never really about the math

Looking back, the spreadsheets weren't the lesson. They were the delivery mechanism for three things that nobody taught us directly.

‍

  • A feel for what normal looks like. After linking monthly returns for a few months or running VLOOKUPs to map the right data to the right composite, you get to know what a normal month looks like and, perhaps more importantly, when one looks off.
  • A map of where things break. Every error made by hand taught us where errors live: the cash flow cutoff, the fee accrual, the stale price, or the account that should have left the composite two months ago.
  • Ownership of the number. When you built it yourself, you could defend it. You knew every assumption inside it.

That is the raw material of judgment. AI doesn't remove the need for it. It removes the accidental way we used to acquire it. So, the answer isn't to preserve busywork for its own sake. It's to identify what the grunt work was teaching and teach it on purpose.

‍

Judgment is the new edge

Shortly after the webinar, I came across a LinkedIn post built on comments NVIDIA CEO Jensen Huang made on the podcast A Bit Personal. Huang pushed back on the usual definition of smart: "somebody who's intelligent, solves [technical] problems." His view: "I find that's a commodity." The people he values are technically astute but can also "infer the unspoken" and "see around corners."

‍

That lands hard in performance measurement. For two decades our credibility rested on getting the math right: time-weighted returns, composite construction, dispersion, three-year standard deviation. Systems already do most of that. AI is now taking the rest.

‍

What remains is the judgment call, the “unknowables.” Is this account still discretionary? Does this cash flow policy make sense for how the strategy is actually marketed? Is this benchmark still the right comparison after the strategy drifted (or the benchmark got too concentrated)?

‍

Those questions don't have a formula and often require interpretation rather than automation. They have experience behind them. And that brings us back to the training problem.

‍

Rebuilding the apprenticeship on purpose

Historically, nobody had to think very hard about how someone learned the job. You hired smart people, gave them the work, and the work did the teaching. Judgment showed up eventually, usually starting somewhere around the end of the first year.

‍

That approach falls apart once the work itself is automated. If we want people who can make good calls, we have to create the experiences that used to happen by accident. I don’t think we have this fully figured out, but these are the five things I keep coming back to.

‍

1. Do it by hand once, then let the machine do it

‍

I still think every new analyst should calculate both time-weighted and money-weighted returns by hand, link a quarter of monthly returns, and put together a small composite from scratch, at least once. Nobody is going to do it that way in production. The point is that it's very hard to supervise a process you've never done yourself. If you don't know where a cashflow belongs in the formula, you won't notice when something is in the wrong place.

‍

Once they've done it, have them run the same data through your automation tools and compare. Sometimes the results match. If they don't, working out why (a different day-weighting convention, a fee treated differently, a cash flow on the wrong date) teaches more about how th calculation really works than any training deck I've seen.

‍

2. Make the reviewer the new entry-level job

‍

For most performance teams, the junior job was to produce the number and someone more senior checked it. Now the machine increasingly produces the number, so the junior job becomes checking it. That's a harder place to start, because we're asking people to review work they may not have spent years doing themselves.

‍

One way to close that gap is to build exercises out of past results. Take AI-generated output and plant real errors (built from anonymized or synthetic examples) seen over the years: a mispriced security, a trade booked a day late, a fee posted to the wrong month, an account that should have left the composite and didn't. Ask newer team members to find them before a senior reviewer does. They may not catch everything at first, and that's fine. Talking through what they missed is where the pattern recognition starts to form, much the way it formed when those mistakes were made by doing the work by hand.

‍

3. Write down the instinct before you investigate

‍

Experienced performance professionals can usually tell something is off before they can explain why. Dispersion that jumps dramatically in a calm quarter. An account that is consistently a composite outlier. A composite return that beats every account in it, by a lot. That instinct is valuable, but it isn't always right. Sometimes it's just bias, and the number is actually fine.

‍

A simple habit helps. When something looks wrong, have the analyst write down what they think is going on before they start digging. Once they've found the answer, have them go back and note whether their first read held up. After a few months they should have a real record of where their instincts are reliable and where they aren't. When those notes are tracked and talked through as part of training, senior team members can see how someone reasons, not just whether they got the right answer.

‍

4. Teach people to hear what isn't in the file

‍

Much of our value sits in the gap between the data and what's happening at the firm. An account quietly drops out of a composite and nobody mentions why. Marketing starts promoting a new strategy before anyone has asked whether it needs its own composite. A portfolio manager mentions "a bit of a style tilt" in passing on a call. None of that is in the file, and AI can only work from the context we provide. If no one recognize what matters and brings it to the table, the tool will never know it was there.

‍

That kind of listening is not new, but it is hard to teach in a classroom. The best way I know is to bring junior team members into the rooms where it happens, early, even if they don't say a word. On an in-house performance team, that might be the monthly attribution review with the portfolio managers, the product committee when a new strategy is on the table, or the kickoff call with your verifier. On our side as consultants, it's client calls and verification kickoffs. In-house teams actually have an advantage here because they sit down the hall from PMs, operations and compliance, and an informal conversation is often where changes show up. Encourage juniors to participate in those conversations instead of working only from the data feed.

‍

Either way, debrief afterward. Ask what they heard that wasn't in the data, and what they would follow up on. The first few answers maybe thin, so share what you heard. Over time they'll pick up on things they used to overlook. That's probably one of the clearest signs that someone is developing real judgment.

‍

5. Turn your own history into the curriculum

‍

Our best training material is our own history of judgment calls. Build a library of real cases (anonymized of course): the facts, what was decided, why, and what you'd do differently now. Include the ones you got wrong.

‍

Run "what could go wrong" exercises together to pass judgment along. Before a verification, exam, or new factsheet goes out, get the team together and ask: "It's six months from now and this went badly. What happened?" Have everyone write their answers down before anyone shares. Newer staff hear what experienced people worry about and why: an undocumented policy change, hypothetical performance shown without the required policies, a net-of-fee calculation that doesn't tie to the fee schedule. That's knowledge that usually takes years to pick up by accident.

‍

What this asks of leaders

This isn't only a training problem. It's a leadership choice about where the time AI saves actually goes.

‍

  • Reinvest the hours. If automation saves a senior reviewer ten hours a month, some of those hours belong to teaching. Otherwise, efficiency quietly eats the pipeline of future experts.
  • Hire for judgment. Give candidates a messy composite file and ask what worries them, rather than screening on credentials alone.
  • Build tools that explain, not just answer. As we build our workbench at Longs Peak, one question I keep asking is whether our tools show its reasoning. A tool that explains why it flagged an account teaches. A tool that just flags it doesn't.
  • Measure what matters. Performance teams measure investment results for a living, yet rarely measure their own judgment. Whether you sit inside an investment firm or advise one, track the issues your team caught before the verifier, auditor, compliance or a regulator did, and who caught them. Over time, that tells you more about how your people are developing than how quickly the reports go out.

‍

The experts of the future won't learn the way we did

That's not a loss if we're deliberate about it. The firms that get this right will use AI to move people faster from producing numbers to questioning them, and they'll treat that shift as a training design problem, not a happy accident.

‍

I don't think anyone has fully solved this yet. We’re trying to be intentional about our future pipeline. I'd like to hear how other performance teams are approaching it. What are you doing to build judgment in people who may never link a return by hand?

‍

And as always, reach out if you want help rethinking how your team builds judgment in performance measurement at hello@longspeakadvisory.com.

‍

‍

Sources

  • Jensen Huang quotes as reported by Upworthy (Feb 3, 2026), from his appearance on A Bit Personal with Jodi Shelton.

‍

Every so often we hear it: "Oh, you're one of the performance software tools."

It's an understandable assumption. We work in the same world as the software providers: composites, Global Investment Performance Standards (GIPS®), performance data, and the systems that produce all of it. From the outside, it can look like we're all selling the same thing.

‍

We aren't. And if you're deciding how to support your performance and GIPS compliance work, the difference is worth understanding.

‍

The short version: Longs Peak is a team of people who do the work with you, or for you. We're not a platform you log into. Behind the scenes, our tools help our team deliver faster, more consistent service. But no number leaves our hands without a real performance expert standing behind it.

‍

Software Gives You a Capability. Someone Still Has to Run It.

‍

A software provider hands you a tool. A good one can be powerful, and those systems offer a ton of capabilities. But once the tool is installed, the work to run it lands on your desk.

‍

Someone on your team still has to load the data, set up and maintain the composites, review the results, chase down the account that looks off, and know the GIPS standards well enough to make the judgment calls. Software can calculate a return. It can't decide whether a new account belongs in a composite, explain why a number moved, or figure out what to do when a custodian changes its data feed.

‍

What We Actually Do

‍

At Longs Peak, we get our hands dirty, so you don't have to. In practice, that means:

‍

  • We manage your composites. Membership decisions, inclusion and exclusion, periodic updates, and the returns that come out the other end. We work alongside     members of your team to get those questions answered and make the updates for you. The work gets done by a person who does it every day.
  • We act as your GIPS expert. When a new strategy launches, a policy needs revisiting, or a gray area comes up, you have someone who knows the standards and has seen the situation before.
  • We dig into your data. We look for outliers, accounts that are breaking composite rules, and other anomalies, before they end up in your reported performance and get caught in verification. Not only do we help identify potential issues, but we work with your team to help create the paper trail to provide an explanation if questioned by a verifier.
  • We help with system issues. When your system isn't producing what you need, we get inside it and help work out why.
  • We design the output. Once the data work is done, we turn it into beautifully designed, client-ready factsheets and reporting. And we understand this information from a performance, compliance, and design perspective.
  • We help you communicate what matters most. For your prospects or a board of directors: which statistics support your story, and which just add noise? Those are communication choices, and we help you make them.

None of this is advice delivered from a distance. We maywork with you as a remote team, but we're not remotely hands-off. We work insideyour data, your systems, and your deadlines, the same way a colleague down thehall would. And when something needs fixing, we roll up our sleeves and fix it,so it’s off your plate and your to-do list.

Ways to Work With Us

‍

Every firm is set up differently, so we don't force a single model.

‍

  • Fully outsourced. We run composite management on your behalf, start to finish. For firms without a dedicated performance team, this is often the cleanest answer.
  • Part of your team. We work alongside your people, taking on the pieces that are heavy, specialized, or just hard to staff. To your colleagues, we're simply part of the performance team.
  • Your GIPS expert on call. Your team runs the day-to-day, and we're there for the questions, reviews, and judgment calls that need someone who has seen it all before.
  • Your marketing team. Your data is done and ready to be put to work. We turn it into polished factsheets and reporting for prospects, consultants, and boards, and help you decide which parts of your story deserve the spotlight.

Many clients start in one place and shift as their needs change. That flexibility allows us to grow alongside you and offer as much or little support as you need.

‍

Why This Matters

‍

Most firms don't struggle with GIPS compliance because they misunderstand a requirement. They struggle because the knowledge lives in one person's head, the team is stretched thin, or a system issue has been quietly sitting in the queue for months.

Software doesn't fix any of those problems. People do. Having an experienced team involved reduces key-person risk, frees your own staff for higher-value work, and means fewer surprises when verification or a regulatory review comes around.

‍

A Question Worth Asking

‍

If the person who runs your performance work were out for a month, who would pick it up? And if the honest answer is "we'd figure it out" or you simply don’t have an answer, it may be time to think about who else should be in the room.

‍

We're happy to talk through where you are today and what kind of support would actually help. No software demo required. Email us at hello@longspeakadvisory.com.

‍

GIPS® is a registered trademark owned by CFA Institute. CFA Institute does not endorse or promote this organization, nor does it warrant the accuracy or quality of the content contained herein.