Investment Performance Outlier Testing

Sean P. Gilligan, CFA, CPA, CIPM
Managing Partner
January 29, 2020
15 min
Investment Performance Outlier Testing

For any firm that aggregates portfolios of the same strategy into a composite, or otherwise groups portfolios by mandate, how do you know that each portfolio truly follows that strategy? The answer is outlier testing.

Why Utilize Composites?

The GIPS standards require firms managing separate accounts to construct composites, which aggregate all discretionary portfolios of the same strategy. However, even for firms that are not GIPS compliant, the use of composites is considered best practice when reporting investment performance to prospective clients. Composites offer a more complete picture than presenting performance of a model or “representative portfolio” – which usually leave prospects wondering whether the information is truly representative or if the portfolio presented was “cherry picked.”

When creating and maintaining composites, firms must ensure that portfolios are included in the correct composite for the right time period – the period for which you had full discretion to implement the composite strategy for that portfolio. This is achieved by following a clearly documented set of policies and procedures for composite inclusion and exclusion. However, what happens when changes are made to a portfolio and those changes are not communicated to the person maintaining the composite?

In an ideal world, information in your firm would flow perfectly so that the person maintaining your composites knows exactly what is happening with the firm’s clients. In reality, client requests commonly result in small or temporary changes to the portfolio (e.g., halt trading, raise cash) that are not formally documented in the client’s investment guidelines or investment policy statement.

Without formal documentation of these changes, information may not flow down to the manager of your composites. While these minor or temporary changes may not affect the client’s long-term objectives, they may cause the portfolio to deviate from the strategy, requiring (at least temporary) removal from its composite. When these restricted portfolios are left in the composite, they often become performance outliers and create “noise” in the composite results. This “noise” prevents the composite from providing a meaningful representation of the portfolio manager’s ability to implement the strategy. This will also interfere with your prospective clients’ ability to analyze and interpret your performance results.

Why test for performance outliers?

Testing for performance outliers prior to finalizing and publishing performance results can help your firm remove this “noise” and can prevent costly errors in performance presentations. Firms that lack adequate composite construction policies and controls to ensure the policies are consistently followed often end up with errors in their composite presentations. In fact, it is very likely that errors in your performance exist. It is rare for us at Longs Peak to conduct an outlier analysis where no issues are found. Outlier testing should be completed quarterly and at a minimum, before any related verification or performance examination.

Many firms, especially those that are GIPS compliant, rely on their verifier to catch errors in their composites. We do not recommend this and suggest firms perform testing internally (or with the help of a performance consultant like Longs Peak) because:

  1. Verifiers only test a sample and will likely not catch all of your issues.
  2. Verification may happen months after the performance has been published. When errors are found, it may require redistribution of presentations with disclosures regarding prior performance errors.
  3. When verifiers find errors, they generally increase their sample size as well as their assessment of engagement risk. These two things lead to more time spent on the verification and a potential increase in your verification fee.

Even if not GIPS compliant, when firms use composites, regulators may test to ensure the composites are a meaningful representation of the strategy. In addition to improving accuracy, testing for performance outliers can help your firm‘s composites meet the standards expected by regulators.

How can performance outliers be identified?

Testing for performance outliers involves reviewing the performance of portfolios within the same composite or strategy to test if they are performing similarly. This testing allows you to flag any portfolios that may be performing differently so you can evaluate if their inclusion in the composite is appropriate.

For example, if your firm has a Large Cap Growth composite, testing performance outliers would involve compiling the return data for all of your Large Cap Growth portfolios, identifying which portfolios performed materially different from their peers, researching why they performed differently, and then taking the appropriate action if an issue is discovered. This may sound like a daunting task, but it doesn’t have to be. Let us walk you through this in more detail.

Some firms simply look at the absolute difference between each portfolio’s monthly return and the monthly return of the composite. While this may be straight forward, relying only on the absolute difference to determine outliers does not take into consideration the size of the return and the normal distribution of portfolio returns in the composite. For example, if you set a threshold to look at all portfolios that deviate from the composite return by 50bps, the result for a composite with low dispersion and a total return of 2% would very be different than a composite with higher dispersion and a total return of 20%.

In the outlier analysis Longs Peak conducts for clients, we use standard deviation in conjunction with a comparison of the absolute differences to identify the outlier portfolios that require review. Utilizing standard deviation allows us to identify portfolios that are truly outside the normal distribution of returns for each period. For example, reviewing all portfolios that are more than 3 standard deviations from the composite mean will provide the portfolios outside the normal distribution of returns for that period, regardless of the size of the return or the level of dispersion in that composite.

What to consider when reviewing outlier performance

The severity of the outlier

The larger the outlier, the more likely it is that the portfolio has an issue that would require it to be removed from the composite. We typically start by looking at the most extreme outliers first. Generally, we look at portfolios with performance periods flagged with +/-3 standard deviations from the mean return for the period. By addressing these first (including removing them if it is determined they do not belong in the composite), we are able to re-run the outlier test to assess what outliers exist without these extreme cases disrupting the analysis.

Once these extreme outliers are addressed, we move on to review the portfolios that are +/-2 standard deviations and even +/-1.5 standard deviations, if needed. We keep reviewing accounts with returns closer and closer to the composite’s mean return until we are consistently confirming that the portfolios do in fact belong in the composite and errors are not being found.

Each firm will be different in how much they need to drill down to get to a point of comfort that no more errors exist. If your composite is managed strictly to a model, the outliers will be very clear and easy to identify. If each portfolio you manage is customized, more research is often needed to determine if the outlier performance is simply a result of the portfolio’s customization or if the portfolio was included in the wrong composite.

How often the portfolio is an outlier

Longs Peak’s performance outlier reports show a portfolio’s performance, the number of standard deviations it is from the mean each month, and the number of months the portfolio was an outlier throughout its history in that composite. Our reports also show whether there was a cash flow during that period or not. The following are examples of outlier frequencies we evaluate:

Infrequent: If you see that a portfolio is only an outlier for one month and that month had a large cash flow, then you will know that the portfolio is likely only an outlier for that period because of the cash flow and, often, no further research is required.

Frequent: If you can see that the portfolio is an outlier for most of the months under review, then you will know that there is likely an issue with this portfolio.

As of a specific date: If you can see that the portfolio was not an outlier historically, but became a frequent outlier from a certain month forward, this may indicate that a restriction was added or that the strategy changed as of that period. The portfolio may then need to be reclassified to the appropriate composite or flagged as non-discretionary.

The most common causes of outlier performance and how to address performance outliers

Common causes of outlier performance:

  • Data issues – When outliers are extreme, it is likely that there is an issue with the data. Examples include a pricing issue that caused a material jump in performance or a late dividend hitting a portfolio that is closing and had most of its assets already transferred out. These issues are often easily addressed, depending on the circumstance of each case.
  • Cash flows – If a portfolio is only an outlier for one month and during that month the portfolio experienced a large cash flow, this is likely the reason for the outlier performance. If the portfolio had high cash for a period of time around the cash flow and the market moved during that period, this portfolio likely would perform differently than its fully invested peers. Nothing needs to be done in this scenario since the outlier performance is explained and there is no indication that the portfolio is invested incorrectly or grouped with the wrong portfolios.
  • Legacy positions or other client restrictions – If your clients hold legacy positions that you are restricted from selling or have other similar restrictions, this will likely cause these portfolios to perform differently when compared to their unrestricted peers. Depending on your composite construction rules, unless immaterial, these portfolios likely need to be excluded from the composite. With these portfolios removed, other outliers may appear that were not as noticeable when the restricted portfolios were included. It is important to refer to your firm’s composite construction policies, which should outline clear parameters for when restricted portfolios should be included/excluded in composites.
  • Portfolio categorized incorrectly – A portfolio may appear as an outlier because it was placed in the wrong composite. This often happens if a portfolio’s composite changed and it was not removed from its prior composite. If this is the case, the portfolio must be removed (after the change) and added to the new composite based on the timing outlined in your firm’s composite construction policies.
  • Portfolio managed incorrectly – Performance outlier analysis may help identify a portfolio that is managed to the wrong strategy. For example, it is possible that the portfolio is grouped with the correct portfolios, but the wrong strategy was implemented in the portfolio. This is one of the most important errors that performance outlier testing can identify because it means that the client is actually not having their money managed to the strategy for which your firm was hired. In this case, the portfolio would need to be rebalanced to the correct strategy. Likely, a review of the history would need to be conducted as well to ensure the client was not disadvantaged by the error.
  • High dispersion between portfolio managers – Especially when more than one portfolio manager is implementing the same composite at your firm, material differences may exist in the way they each manage the strategy. Outlier performers may be due to differences in the portfolio managers’ discretionary management. If the composite is being sold as one cohesive product, it is important to identify where the portfolio managers deviate and determine if they can work more closely together to avoid high dispersion or if the strategy should actually be run as two different products.

When researching outlier performance, keep in mind that, on its own, a portfolio’s performance deviating from its peers is not a valid reason to remove the portfolio from its composite. You need to determine the root cause of the deviation and remove the portfolio from its composite only if the root cause was client-driven. If the deviation was caused by tactical, discretionary moves made by the portfolio manager, the portfolio must remain in the composite as its performance is still a representation of the portfolio manager’s implementation of the strategy.

Ready to implement performance outlier testing at your firm?

While it is best practice to create a flow of information that will allow portfolios to proactively be included/excluded in the correct composite at the appropriate time, testing for performance outliers acts as a back-up plan to catch anything that was missed.

If analyzing your composite data to identify performance outliers is not something you have the resources to do internally, Longs Peak is available to help. Longs Peak offers both consulting and reporting services that can assist your firm with outlier analysis. Conducting outlier analysis should be done at least quarterly to help ensure your firm is managing your portfolios consistently and are reporting strategy or composite performance that is meaningful and accurate. Please contact us to discuss how we can help implement this practice for your firm.

Questions? 

If you have questions about investment performance, composite construction, or the GIPS standards, we would be love to talk to you. Longs Peak’s professionals have extensive experience helping firms with all of their investment performance needs. Please feel free to email Sean Gilligan directly at sean@longspeakadvisory.com.

Recommended Post

View All Articles

Most managers assume that losing an allocation comes down to returns. Underperform the benchmark, underperform peers, and the mandate goes elsewhere. That happens, but it's not usually the reason a manager gets cut from a search after the numbers already looked competitive.

More often, it's something in how the performance was presented that made an allocator hesitate. A number that didn't match across two documents. A risk statistic nobody could explain. A question in due diligence that the manager couldn't answer cleanly. None of these are calculation errors. They're trust problems, and trust is what allocators are ultimately seeking when they write a check.

Here are the performance problems we see that cost managers allocations most often, and none of them start with the returns themselves.

The Numbers Don't Match Across Documents

An allocator pulls up your factsheet, your pitchbook, and your GIPS® Composite Report, and the composite's five-year return isn't quite the same in all three. Maybe it's a rounding difference, or the factsheet reflects a different "as of" date. The allocator doesn't know that, and they aren't going to assume the best. Inconsistency reads as carelessness, and carelessness in performance reporting raises an obvious question: what else isn't being checked?

This is why we push firms to treat marketing and GIPS compliance as one coordinated process rather than two departments working from different source files. Every document that leaves the building should trace back to the same underlying data.

This matters even more now that due diligence itself is being automated. Operational due diligence teams and consultants are increasingly running AI tools that cross-check pitchbooks, factsheets, DDQs, and regulatory filings against each other, flagging contradictions that used to slip through manual review. A rounding difference or a stale figure that a person might have missed a few years ago is exactly the kind of inconsistency these tools are built to catch instantly. Clean, consistent marketing materials aren't just good practice anymore — they're what it takes to pass a review that may happen before a person ever looks at your numbers.

Performance That Looks Selected, Not Reported

Showing your best-performing account, your best-performing period, or a composite with an unusually small number of accounts invites the question every allocator is trained to ask: what am I not being shown? Due diligence teams know that everyone can't be top quartile. The SEC Marketing Rule's anti-cherry-picking provisions exist because this pattern is common enough that regulators built rules around it, and sophisticated allocators are watching for it. If your performance can be read as overly flattering rather than representative, assume a diligence team will read it that way.

Wanting to lead with your best numbers is an understandable impulse. But diligence teams are trained specifically to spot it, and selective disclosure, even when every number in it is accurate, tends to read as a bigger warning sign than an honest, complete track record would. The stronger story is discipline: the periods where you held to your stated mandate and didn't deviate even while returns lagged. That's a harder story to tell than "we outperformed," but it's the one that actually holds up, because it shows you didn't drift toward whatever was working elsewhere just to keep pace. Chasing returns outside your stated process isn't skill, it's strategy drift, and allocators are trained to spot that just as readily as cherry-picked out performance.

Our advice: resist the instinct to lead with your best examples, and show the scenarios that build trust instead. We recommend showing the ones that demonstrate you stuck to your stated mandate, policies, and procedures, especially when the outcome wasn't your best quarter. Discipline under pressure is a more durable credential than a strong one-off time period, and it's the kind of evidence that holds up long after that number is forgotten.

Statistics You Show But Can't Explain

A page full of risk statistics doesn't build confidence on its own. It invites a follow-up question, and if the manager can't explain what a downside capture ratio of 85% says about the decisions actually made in the portfolio, the statistic becomes a liability instead of an asset. Allocators aren't just checking whether the numbers are favorable. They're checking whether the manager understands their own portfolio well enough to explain it. Statistics presented without interpretation signal that the second answer is “no.”

Likewise, a page of portfolio characteristics that have nothing to do with how the strategy is actually run are not doing you any favors. If you're not making decisions at the sector level, a sector breakdown doesn't tell an allocator anything about your process. If you don't manage individual position sizing, a top-ten holdings list is not adding value.

Your factsheet should be a roadmap for the conversation you want to have, not a checklist of everything other managers include. Every number on it should be something you can explain: how it got there, what decision it reflects, and what it says about how you manage money. A statistic that's only there because everyone else shows it likely isn't helping you if it doesn’t demonstrate active decision making. It's inviting a question you may not have a good answer to.

It's the same logic as a good resume. One padded with every certification, hobby, and unrelated past role doesn't read as impressive, it reads as overwhelming and maybe irrelevant, and it makes the reader work harder to find what actually matters to the job at hand. A factsheet works the same way. The strongest ones include only what's relevant to the case being made and make it easy to connect every line back to it.

No One Can Explain Why a Decision Was Made

This is the one that costs managers the most, and it's rarely about the numbers at all. An allocator asks why a composite was redefined, why a benchmark changed, or why a particular account was excluded, and the answer is a shrug or "that's how we've always done it." Undocumented decisions create the impression that performance is being managed reactively rather than governed intentionally. Firms that can point to a clear, contemporaneous record of why a judgment call was made close that conversation quickly. Firms that can't do this will leave the allocator wondering what other judgment calls haven't been documented either.

The Common Thread

None of these problems are really about whether the strategy performed well. It comes down to whether the story behind the numbers holds up consistently under scrutiny. Allocators aren't just buying returns. They're also buying confidence that what they're being shown today will still be true, and still explainable, a year from now.

The fix isn't more disclosure for its own sake. It's making sure everything across your performance reporting tells the same, well-documented story before an allocator ever has the chance to ask why it doesn't.

GIPS® is a registered trademark owned by CFA Institute. CFA Institute does not endorse or promote this organization, nor does it warrant the accuracy or quality of the content contained herein.

There is a common assumption among boutique investment managers that the Global Investment Performance Standards (GIPS®) are built for the largest firms in the industry — that compliance is something you pursue once you've reached a certain scale, a certain client type, or a certain level of institutional credibility.

That assumption is understandable. And it is costing firms real opportunities.

The GIPS standards have no AUM threshold to get started. There is no minimum number of clients or composites required before a firm can claim compliance. And increasingly, the institutional marketplace is not waiting for firms to reach some undefined moment of readiness before asking for it. If you are newer to the GIPS standards and want a foundation for what they are and why firms pursue them, start with our post What Are the GIPS Standards?

 

The Market Has Already Decided

The gatekeepers of institutional capital such as consultants, outsourced CIO platforms, model delivery networks, and institutional allocators, have been quietly raising the bar on performance reporting standards for years. GIPS compliance has shifted from a differentiator to a baseline expectation in many of these channels.

According to eVestment, two out of three manager searches conducted by investors and consultants on their platform exclude firms that are not GIPS compliant. That means boutique managers without a compliance claim are not being passed over, they are simply not being seen. As we explored in From Compliance to Growth, GIPS compliance has effectively become the price of admission for firms seeking to expand into institutional channels.

The question is not whether your firm will eventually need it. For most managers with institutional ambitions, the answer to that question is already yes. The real question is when you choose to pursue it, and whether you make that choice on your own terms or in response to a mandate you cannot afford to lose.

 

What Compliance Actually Builds Inside Your Firm

The benefits most managers focus on are external. Things like the credibility signal, the access to channels, the due diligence box that gets checked. Those benefits are real. But some of the most meaningful returns from GIPS compliance are internal.

Implementing the GIPS standards requires firms to formalize processes that often exist informally. Composite definitions. Discretion criteria. Benchmark selection rationale. Fee policies. Error correction procedures. For many boutique managers, the implementation process is the first time these decisions have been documented and applied consistently across the firm.

That discipline matters beyond GIPS compliance itself. A firm with clean, documented performance infrastructure is better positioned for regulatory examinations, investor due diligence, and operational due diligence reviews. It demonstrates to sophisticated allocators that the firm is run with the same rigor they apply to their own oversight responsibilities. And for firms that are not primarily focused on institutional distribution, this operational foundation has standalone value, the kind of infrastructure that supports sound governance regardless of who is asking. For more on what a well-governed GIPS compliance program looks like once it is in place, see What Good GIPS Compliance Governance Looks Like in Practice.

 

The Single Best Argument for Starting Now

Here is the point that does not get made often enough: the smaller your firm and the shorter your track record, the easier it is to become compliant. That ratio flips quickly as you grow.

Retroactively constructing composites across a large number of separate accounts is genuinely difficult work, particularly when no framework existed at the time to assign accounts to composites at inception, or to move accounts between composites as investment objectives changed, client restrictions were added or removed, or mandates evolved. Working through that history portfolio by portfolio, period by period, requires both detailed documentation and sound judgment. It is one of the most time-consuming phases of any GIPS compliance implementation, and the complexity compounds with every account and every year of history added.

A firm with 30 separate accounts and a two-year track record faces a very different implementation project than the same firm a few years later with 500 accounts and a five-year track record. The strategy, the clients, and the investment process may be nearly identical, but the administrative burden of reconstructing historical composite membership correctly is not.

The firms that find implementation most manageable are the ones that started before the project grew into something unwieldy. The firms that find it most painful are the ones that waited until an institutional prospect made it urgent.

What if you are not ready to commit to full compliance yet?

That is a legitimate position. But there is a practical middle path worth considering: even if a firm does not want to claim compliance with the GIPS standards today, building out the composite structure and creating policies and procedures for managing those composites now is a worthwhile investment. That framework does not require a formal compliance claim to be useful. Additionally, it can be carried directly into a full GIPS compliance program when the time is right, dramatically reducing the effort required at that stage.

 

The Real Costs

Becoming GIPS compliant requires real work, and it is worth being direct about what that entails. At a high level, implementation comes down to four phases: defining the firm, building a GIPS standards policies and procedures manual, constructing composites and calculating performance, and creating GIPS Reports with ongoing monitoring controls. We walk through each phase in detail in A Practical Framework for Implementing the GIPS Standards.

In terms of ongoing commitment, firms should expect monthly composite management, annual GIPS Report updates, periodic policies and procedures reviews, and distribution tracking. For a lean team, owning all of this internally is often not realistic. The good news is that outsourcing to a GIPS compliance consultant is a well-established path for boutique managers and one that many firms in our client base have taken successfully. The total cost of compliance for a focused, well-organized firm is frequently lower than managers expect, particularly when implementation is approached while the firm's history and account universe are still manageable.

 

Is This the Right Time for Your Firm?

Not every firm is at the same point in this decision. Managers with the strongest case for pursuing GIPS compliance now include:

  • Firms actively pursuing institutional mandates or seeking coverage from investment consultants
  • Managers on model delivery platforms or building toward that distribution channel
  • Firms planning meaningful growth over the next two to three years
  • Any manager whose clients or prospects have already raised the question
  • Firms that simply want to build a best-in-class performance reporting foundation, regardless of where their distribution strategy stands today

The case is lower urgency for firms focused exclusively on high-net-worth or retail clients with no near-term institutional ambitions; however, there is still value in building a sound performance reporting structure, and the sooner it is established, the easier the work will be.

On Verification: You Can Wait

Verification is independent, voluntary, and valuable. It is also not required to claim compliance with the GIPS standards, and for cost-conscious boutiques, it is a reasonable place to exercise flexibility.

A firm can become GIPS compliant today and gain all the operational benefits and the ability to make the compliance claim and defer pursuing verification until there is specific demand for it. When an institutional prospect or consultant asks whether the firm is verified, that is the right moment to add it. The compliance foundation built now makes that future engagement faster and less disruptive. For a detailed walkthrough of what the verification process involves, see our series How to Survive a GIPS Verification.

Verification is worth having. It just does not need to happen on day one.

 

The Longer You Wait, The Heavier the Lift

GIPS compliance is not an initiative that gets easier with time. Every year a firm grows its account base, extends its track record, and adds complexity to its operations without a compliance framework in place is another year of history that will eventually need to be organized, documented, and reconstructed.

The managers who find implementation most straight forward are not the ones with the most resources. They are the ones who started early enough that the project was still proportionate to the size of the task.

If your firm is headed toward institutional distribution (most boutique managers we work with are), the best time to build this infrastructure is before you need it. The second best time is now.

 

Longs Peak Advisory Services specializes in GIPS compliance and investment performance consulting for investment managers and asset owners. We have helped over 250 firms implement and maintain compliance with the GIPS standards. If you are evaluating whether now is the right time for your firm, we would be glad to talk through it. Reach out athello@longspeakadvisory.com.

 

GIPS® is a registered trademark owned by CFA Institute. CFA Institute does not endorse or promote this organization, nor does it warrant the accuracy or quality of the content contained herein.

Every Spring, the performance measurement community gathers for PMAR: The Performance Measurement, Attribution & Risk Conference, hosted by TSG. This year marked the twenty-fourth annual, and I left thinking about it differently than I have in years past.

Most years, the themes evolve gradually. This year, I felt like the ground was moving.

The theme nobody put on the agenda but ran underneath nearly every session was the pace of change. Specifically, what artificial intelligence is about to do to our work. And while I came away energized, I also came away with a healthy dose of " we (as in everyone) are not ready for how fast this is coming."

Here's what stayed with me.

AI Was the Undercurrent of the Whole Event

The session titled "AI, Anxiety, and Opportunity: What Performance Professionals Need to Know" was, predictably, one of the most sought-after sessions of the conference. The panel, which included practitioners from across the industry, did a nice job naming both sides of the coin: the anxiety of not knowing what your job looks like in five years, and the opportunity sitting right in front of us if we lean in.

Here's my honest read of the room, though. The mood was optimistic. Maybe a little too optimistic. There was a comfortable assumption that AI will mostly handle the tedious parts and leave the interesting work to us. Or that AI won’t take your job, someone that knows AI will. I'm not sure it'll be that tidy.

From what we're already seeing in our own work and across the firms we serve, the capabilities are advancing faster than most people can comprehend. The days where “our industry is just slower to adapt” are gone. Just last week, anthropic released Fable 5 and before it was shut down (temporarily?), we played around with it a little and its capabilities are dumbfounding. I don't think it will be long before these conferences look drastically different. Different sessions, different vendors, maybe a different sense of what the job even is. That's not a doom prediction. It's just a reason to pay closer attention than feels comfortable.

Separating Skill From Luck Just Got Harder and More Important

One of my favorite sessions was Michael Ervolini's "You Can't Find Skill in Returns: Distinguishing Performance From the Decisions That Generate Them." It's a deceptively simple premise: returns tell you what happened, not whether the manager was actually good. A great number can come from a great decision, or from luck. A bad number can hide genuine skill.

What I appreciate about PMAR is that the community keeps bringing fresh perspectives to this old, hard problem: how do we actually evaluate skill versus luck? It's a question that never fully resolves, and every year someone pushes the thinking forward.

It struck me that this question gets more important in an AI world, not less. As machines take over more of the calculation and even some of the decision-making, our value shifts toward judgment – knowing which decisions deserved credit, which results were noise, and what a number actually means in context. That's the kind of discernment a model can assist with but can't own. For more from Mr. Ervolini, here's a link to his latest book Skill vs. Luck.

The GIPS Challenges That Keep Coming Back

I'm biased here, but the "Common GIPS Challenges and How to Avoid Them" session was a highlight for us, in part because our own Matthew Deatherage, CFA, CIPM, was on the panel alongside peers from TSG, MassPRIM, and Strategic Investment Group.

What I always find striking about this topic is how consistent the challenges are. Firms pursuing compliance with the Global Investment Performance Standards (GIPS®)* tend to stumble on the same handful of issues year after year, and almost all of them are avoidable with the right foundation in place. That's a big part of why we do what we do at Longs Peak: helping firms get ahead of those pitfalls instead of discovering them during verification or, worse, during a regulatory exam.

Matt is a familiar face on these panels, and it's great to have our perspective in the mix. But the takeaway that stuck with me tied right back to the AI thread running through the whole conference.

Across several different panels, presenters talked about feeding the GIPS standards into their own AI models to churn out GIPS reports. And here's the thing, anyone can do that. You can drop the standards into a model in minutes. What a model can't do is provide critical judgment about how a principles-based framework should be applied to your specific facts and circumstances and whether those GIPS reports and statistics were calculated correctly. The GIPS standards aren't a checklist; they're a set of principles that require interpretation, and interpretation is exactly where experience earns its keep.

I'm not saying don't use AI to help build a framework. Use it. But like any model, if you don't really know what you're asking it to do, the output won't save you. Simply asking a model to "make my firm GIPS compliant" isn't going to make it so. At least not yet!

And there's one problem every performance professional already knows AI hasn't solved: data. As they say, garbage in, garbage out. Meaningful performance lives and dies on clean, well-organized data, and no software tool or AI model fixes messy inputs alone. At Longs Peak, we have spent the last 10 years working with clients to improve data quality through data integrity testing. For us, these AI models have only expanded what’s possible. We know one thing for sure: setting these tools up with the proper context (i.e., knowing what to look for) and then evaluating that context on an ongoing basis may turn out to be the most crucial piece of it all.

CFA Institute Is Listening on the CIPM

A session I didn't expect to find as interesting as I did was "CIPM Through the Practitioner Lens," facilitated by Rob Langrick of CFA Institute. Rather than simply presenting at the room, CFA Institute came to listen and gather candid feedback on the CIPM designation: where it's delivering value, where it's falling short, and how it should evolve to stay relevant to the work we actually do day to day.

The audience didn't hold back, and there were some genuinely thoughtful suggestions including how the code of ethics will evolve in this new AI era, some recommendations on reformatting the exam to break it into smaller chunks (going into greater detail on each) as well as adding a CIPM group within the CFA societies to encourage further connection. It was refreshing to see CFA Institute putting real energy behind a credential that so many of us have invested in and want to see grow in value. Given the pace of change in our field, willingness to adapt feels necessary. For anyone interested in contributing ideas to the CIPM, you can use this link to provide feedback.

A Quick Word on the Trivia

I'd be remiss not to mention that Performance Trivia got a much-needed upgrade this year. In past years, only a handful of contestants got to play while the rest of us watched (though in fairness, not all of us were clamoring for the spotlight). The new format this time allowed everyone to participate (without taking center stage), and it was a lot more fun for it. A small change, but it captured something I value about this community: it's competitive, but it's also genuinely collegial and prides itself on memorizing quirky names and vintage formulas.

Before PMAR Even Started: Women in Performance Measurement

For me, the week actually started the day before the conference, at the Women in Performance Measurement (WiPM) gathering. An event created just for the women in our industry. It's one of my favorite parts of this trip every year, and not only because the conversation is good. There's something energizing about being in a room full of women who do this work, comparing notes and reconnecting.

Fittingly, AI came up here too, though in a much more hands-on way than it would on the main stage. Practitioners shared real use cases, both personal and professional: the small ways AI is already saving them time day to day, and the bigger experiments they're running at their firms. It was practical, curious, and refreshingly free of hype.

We were also lucky to have a guest speaker, Lidia Arshavsky, who spoke on executive presence. She broke down how executive presence actually gets evaluated inside organizations (the signals people pick up on, often without realizing it) and offered practical recommendations for strengthening your own. It was the kind of talk that's useful no matter where you are in your career.

It was a great way to kick off PMAR, and an even better way to reconnect with women I only get to see a few times a year. Sometimes the most valuable part of a conference happens in these opportunities to network and reconnect within our niche performance community. A big thank you to TSG who donated the space for this event to take place and have done so for many years.

What AI Can't Take From Us

The conference's forward-looking sessions, including "Innovative Ways to Present Performance: Dashboards & Analytics," got me thinking. The tools are evolving so quickly and so much of the analysis, presentation, and reporting can now be automated. I am left wondering how long the traditional use of software in our space will last in its current form.

When the capabilities advancing fastest don’t always come from the established vendors, who benefits? My hope is that everyone does. That these tools level a playing field that used to tilt heavily toward the largest institutions, give smaller firms the ability to deliver high-caliber analytics previously out of reach, and push the whole field toward better solutions. That makes for a more competitive space and ultimately a clearer picture for investors to evaluate their options.

That's the optimistic case, and I believe it. But it only holds if we stay clear-eyed about where our own value comes from and that's the note I want to leave you on. The pace of change is a reason to focus, not to panic. The things that make us valuable are the things AI can't take: consciousness, judgment, and the human-in-the-loop accountability that clients ultimately trust. Machines will calculate faster and present prettier. They won't sit across the table from a client and take responsibility for what a number actually means.

So, by all means, get curious about the tools (Claude seemed to be most people’s favorite – mine as well). Experiment. Don't be the individual or firm that gets left behind. But anchor yourself in the part of this work that's irreplaceably human, because that's the part that was always the point.

See you at PMAR 2027. I suspect it'll look a little different.

________________________________________

GIPS® is a registered trademark owned by CFA Institute. CFA Institute does not endorse or promote this organization, nor does it warrant the accuracy or quality of the content contained herein.