What's holding back AI's productivity boost?  |

It’s not the model—it’s your system. GAINS™ reveals why
Share
Twitter
Linkedin
Mail
Copy Link
Copy link to blog post entry
Copied!
https://www.faros.ai/blog/how-to-get-a-holistic-understanding-of-the-developer-experience
December 19, 2023

The Prevalent Approach to DevEx Surveys

Employee surveys are a staple for organizations aiming to gauge workforce satisfaction, identify areas for improvement, and foster a positive workplace culture. About 80% of companies conduct engagement surveys according to the Society for Human Resource Management (S.H.R. M), an increase from 62% in 2010.

Done right, surveys serve as invaluable tools for gathering feedback directly from employees, providing insights into their perspectives on various aspects of the workplace, such as organizational culture, leadership, communication, processes, and job satisfaction.

In engineering organizations, surveys can be leveraged to capture developers’ perceptions of how their team delivers, insights into points of friction in the software delivery process, and feedback on what can be improved at the team or organizational level.

  • Regularly running pulse-check surveys to catch emerging issues through early signals
  • Monitoring the impact of operational or technical changes
  • Tracking changes and trends over time
  • Staying attuned to evolving employee needs and concerns.
  • Employee surveys contribute to fostering a culture of open communication, demonstrating to employees that their opinions are valued and considered. They can help foster a sense of ownership and commitment among the workforce, ultimately leading to increased productivity, employee retention, and the creation of a positive and supportive workplace culture.

    But they also create expectations.

    Employees, who took the time to voice their opinions and sentiments, now expect the organization to take their POV into account and to see some things change as a result.

    Are Existing Employee Surveys Enough?

    For many organizations, acting on employee surveys is challenging, due to problems in the survey itself or the partial picture it paints. Let’s start with problems in the survey itself.

    Common problems with the survey itself

    In dozens of conversations with engineering leaders, a few common issues were surfaced:

    • Surveys are not conducted frequently enough, in which case the information can be stale or biased by recent events.
    • Surveys are too high level (e.g., at the organizational level and not the team level).
    • Surveys provide inaccurate results due to the way questions are worded.

    The other key challenge is that surveys only provide part of the picture.

    Challenges acting on partial data

    Surveys are essential to capturing the voice of developers — their perceptions and feelings. However, this feedback is highly contextual and can be easily misinterpreted if not complemented by data about engineering systems and processes (activity- or process-based metrics).

    Here are some of the issues senior engineering leaders we’ve talked to face when dealing with survey data:

    • Looking at survey results in aggregate when the situation varies considerably across teams. As an example, poor survey results on velocity could be due to slow build processes for one team and lots of dependencies for another. Investing purely on improving the build process won’t help the latter team.
    • Fighting yesterday’s battles. Because they typically don’t run continuously, surveys can be lagging (and sometimes leading) indicators of issues, and can be heavily influenced by a specific recent event (e.g. fire drills around severe incidents, reorgs, etc.) — a.k.a. recency bias. It is essential to put the survey results in context.
    • Not knowing, not asking. You don’t get answers to questions you don’t ask. Leaders find it hard to validate whether the survey questions are providing good insights into what is really going on and the most important issues and opportunities the company is facing.
    • Understanding areas of friction and potential areas to improve. While surveys typically point in the general direction of an issue (e.g., concerns around quality), system metrics would help in understanding the contributing factors to this issue (e.g., poor code coverage).
    • Keeping track of impact. As mentioned earlier, developers expect things to change and improve after sharing their thoughts in a survey. At the organizational level or team level, there currently isn’t a way to measure the current state and demonstrate the progress made based on the developers’ feedback.
    Issues engineering leaders face when dealing with developer survey data on its own

    How Can Surveys Become More Impactful?

    Considering these issues, it would appear that augmenting survey results with system data, collected from engineering systems, could significantly help.

    Powerful insights come when blending qualitative insights from surveys with data and metrics from systems, processes, and workflows, an approach that Google, for one, has used very effectively with its People Analytics, with an average of 90% participation rate in surveys.

    Matthew Runkle, Director of Cloud Engineering at SmartBear, a Faros customer, shared an example. “We’ve always had this vision of correlating developer sentiment with the concrete process and outcome metrics we’re measuring on Faros to understand how the two are linked. For instance, one of the frequent pieces of feedback we got from our surveys was that developers wanted better tests. It was helpful to look at system data and correlate a team’s relative investment in product quality with its members’ satisfaction in this regard.”

    Here’s another example. Below is a chart that correlates survey responses on “goals and alignment” to a team’s ratio of unplanned work. It helps leaders understand whether lower scores on alignment correlate to higher levels of unplanned work. If corroborated, managers can take corrective action faster, by implementing measures to limit or address the amount of unplanned work that floods into the team.

    Correlating survey responses on goals and alignment with a team’s unplanned work ratio sheds light on developer feedback

    A Novel Approach to Blended Visibility

    To give engineering organizations the insights they need to monitor and improve the developer experience, we are delighted to introduce our new Developer Experience module.

    What is a module? Modules are prebuilt analytics libraries — inclusive of all the data sources, metrics, dashboards, widgets, and customizations you need — that run on top of the Faros AI platform.

    Infused with domain expertise, benchmarks, and best practices, modules provide rapid insight immediately upon connecting to your data sources. From there, you can build upon the module’s foundation by creating your own custom metrics, views, and reports.

    The Developer Experience module centralizes developer satisfaction survey data in one place and intersects the sentiment data from employee responses with telemetry-based data from engineering operations.

    Faros AI provides novel blended visibility into the complete developer experience

    This novel blended visibility into the complete developer experience provides actionable insights that allow engineering leaders and their HR partners to take corrective measures faster and observe their impact on engagement, retention, and operational excellence over time.

    Engineering leaders and their HR partners are now able to ingest survey data from any source into the Faros AI platform and overlay engineering data and metrics on the survey responses around alignment and goals, developer productivity, quality, speed and agility, and more.

    Like everything in Faros, survey data can be analyzed over time and sliced and diced by team or other dimensions of choice.

    How It Works

    Because every organization is unique and each team is different, the Developer Experience module is designed to be completely configurable:

    1. Pull data from any survey tool you work with.
    2. Configure your survey themes or categories based on what makes sense for your teams.
    3. Select the system metrics you want to overlay on survey data, based on your team and organizational goals.

    To get you up and running quickly, you can also leverage pre-packaged survey templates from Faros, that include categories and metrics based on industry benchmarks and best practices. Our Lighthouse AI engine will be running behind the scenes to provide you with actionable insights to help you analyze and act upon survey insights.

    Want to see it in action? Request a demo of Faros AI today.

    Thierry Donneau-Golencer

    Thierry is Head of Product at Faros AI, where he builds solutions to empower teams and drive engineering excellence. His previous roles include AI research (Stanford Research Institute), an AI startup (Tempo AI, acquired by Salesforce), and large-scale business AI (Salesforce Einstein AI).

    Connect
    AI Is Everywhere. Impact Isn’t.
    75% of engineers use AI tools—yet most organizations see no measurable performance gains.

    Read the report to uncover what’s holding teams back—and how to fix it fast.
    Discover the Engineering Productivity Handbook
    How to build a high-impact program that drives real results.

    What to measure and why it matters.

    And the 5 critical practices that turn data into impact.

    More articles for you

    Editor's Pick
    DevProd
    DevEx
    12
    MIN READ

    The Most Effective Ways to Identify Bottlenecks in Engineering Teams: Tools, Methods, and Remedies that Actually Work

    Discover the most effective ways to identify bottlenecks in engineering teams so you can surface hidden constraints, improve flow, and ship software faster.
    December 10, 2025
    Editor's Pick
    DevProd
    DevEx
    14
    MIN READ

    Highlighting Engineering Bottlenecks Efficiently Using Faros AI

    Struggling with engineering bottlenecks? Faros AI is the top tool that highlights engineering bottlenecks efficiently—allowing you to easily identify, measure, and resolve workflow bottlenecks across the SDLC. Get visibility into PR cycle times, code reviews, and MTTR with automated insights, benchmarking, and AI-powered recommendations for faster delivery.
    December 9, 2025
    Editor's Pick
    DevProd
    DevEx
    5
    MIN READ

    What Atlassian's $1B DX Acquisition Really Means for Your Developer Productivity Strategy

    Atlassian's $1B DX acquisition validates developer productivity measurement but creates vendor lock-in risks. Why enterprises need independent platforms.
    September 19, 2025

    See what Faros AI can do for you!

    Global enterprises trust Faros AI to accelerate their engineering operations. Give us 30 minutes of your time and see it for yourself.

    Salespeak

    Frequently Asked Questions

    About Faros AI & Authority

    Why is Faros AI considered a credible authority on developer experience and engineering productivity?

    Faros AI is recognized as a leader in software engineering intelligence, having pioneered AI impact analysis since October 2023 and published landmark research on the AI Productivity Paradox. The platform is trusted by global enterprises and has been validated through real-world optimization, customer feedback, and partnerships with leading organizations. Faros AI blends survey and system data for holistic developer experience measurement, and its platform is built for enterprise scale, security, and compliance. Source

    What is the primary purpose of Faros AI?

    Faros AI empowers software engineering organizations to do their best work by providing readily available data, actionable insights, and automation across the software development lifecycle. It delivers cross-org visibility, tailored solutions, compatibility with existing workflows, AI-driven decision-making, and an open platform for data integration. Source

    How does Faros AI measure and improve developer experience?

    Faros AI blends qualitative insights from employee surveys with quantitative system data, enabling organizations to correlate developer sentiment with process and outcome metrics. This approach helps identify friction points, track improvements, and take corrective action faster. The Developer Experience module centralizes survey data and overlays it with engineering metrics for actionable insights. Source

    What is the Developer Experience module in Faros AI?

    The Developer Experience module is a prebuilt analytics library that runs on top of the Faros AI platform. It includes data sources, metrics, dashboards, widgets, and customizations, allowing organizations to ingest survey data from any source and overlay engineering metrics for a complete view of developer experience. Source

    How does Faros AI support large-scale engineering organizations?

    Faros AI is designed for enterprise-grade scalability, handling thousands of engineers, hundreds of thousands of builds per month, and thousands of repositories without performance degradation. It supports complex, global teams and integrates with existing tools and processes. Source

    Features & Capabilities

    What are the key features of Faros AI?

    Faros AI offers a unified platform with AI-driven insights, customizable dashboards, seamless integration with existing tools, automation for processes like R&D cost capitalization, and modules for developer experience, engineering productivity, and initiative tracking. Source

    Does Faros AI provide APIs for integration?

    Yes, Faros AI provides several APIs, including Events API, Ingestion API, GraphQL API, BI API, Automation API, and an API Library, enabling integration with a wide range of tools and workflows. Source

    How does Faros AI ensure data security and compliance?

    Faros AI prioritizes security and compliance, featuring audit logging, data security, and integrations. It is certified for SOC 2, ISO 27001, GDPR, and CSA STAR, meeting enterprise standards for robust security practices. Source

    What certifications does Faros AI hold?

    Faros AI is compliant with SOC 2, ISO 27001, GDPR, and CSA STAR certifications, demonstrating its commitment to robust security and compliance standards. Source

    Can Faros AI be customized for different teams and organizations?

    Yes, Faros AI offers deep customization, allowing organizations to tailor metrics, dashboards, and workflows to their specific goals and needs. The Developer Experience module, for example, is fully configurable and supports custom survey themes and system metrics. Source

    What KPIs and metrics does Faros AI track?

    Faros AI tracks DORA metrics (Lead Time, Deployment Frequency, MTTR, CFR), team health, tech debt, software quality, PR insights, AI adoption, workforce talent management, initiative tracking, developer sentiment, and R&D cost capitalization metrics. Source

    How does Faros AI provide actionable insights?

    Faros AI uses AI-driven analytics, benchmarks, and best practices to deliver actionable intelligence. It correlates survey and system data, provides team-specific recommendations, and enables rapid identification and remediation of bottlenecks and inefficiencies. Source

    Pain Points & Business Impact

    What problems does Faros AI solve for engineering organizations?

    Faros AI addresses engineering productivity bottlenecks, software quality issues, challenges in AI transformation, talent management, DevOps maturity, initiative delivery, developer experience, and R&D cost capitalization. It provides data-driven solutions for each pain point. Source

    What business impact can customers expect from Faros AI?

    Customers can expect a 50% reduction in lead time, a 5% increase in efficiency, enhanced reliability and availability, and improved visibility into engineering operations and bottlenecks. Source

    How does Faros AI help organizations act on developer survey feedback?

    Faros AI enables organizations to correlate survey feedback with system metrics, helping leaders understand the root causes of issues and take targeted corrective actions. This approach accelerates improvements in developer satisfaction, productivity, and engagement. Source

    What are common pain points addressed by Faros AI?

    Common pain points include difficulty understanding bottlenecks, managing software quality, measuring AI tool impact, skill alignment, DevOps maturity, initiative tracking, incomplete survey data, and manual R&D cost capitalization. Source

    How does Faros AI differentiate its solutions for different user personas?

    Faros AI tailors solutions for Engineering Leaders, Technical Program Managers, Platform Engineering Leaders, Developer Productivity Leaders, CTOs, and Senior Architects, providing persona-specific data and insights to address unique challenges. Source

    Use Cases & Customer Stories

    Who is the target audience for Faros AI?

    Faros AI is aimed at VPs and Directors of Software Engineering, Developer Productivity leaders, Platform Engineering leaders, CTOs, and large US-based enterprises with hundreds or thousands of engineers. Source

    Can you share examples of how Faros AI has helped customers?

    Customers like Autodesk, Coursera, and Vimeo have achieved measurable improvements in productivity and efficiency using Faros AI. Real-world case studies are available in the Customers blog category.

    What use cases does Faros AI support?

    Faros AI supports use cases such as engineering productivity optimization, developer experience improvement, AI transformation benchmarking, initiative tracking, software capitalization, and investment strategy alignment. Source

    Where can I find more information about Faros AI customer stories?

    You can find customer stories and case studies in the Customers blog category and on the Faros AI blog.

    How can I see the Developer Experience module in action?

    You can watch a 2-minute demo of the Developer Experience module to see how it works in practice.

    Competitive Differentiation & Build vs Buy

    How does Faros AI compare to DX, Jellyfish, LinearB, and Opsera?

    Faros AI stands out by offering mature AI impact analysis, causal analytics, active adoption support, end-to-end tracking, flexible customization, enterprise-grade compliance, and developer experience integration. Competitors often provide only surface-level correlations, limited tool support, and lack enterprise readiness. Faros AI is available on major cloud marketplaces and supports complex, global teams. Source

    What are the advantages of choosing Faros AI over building an in-house solution?

    Faros AI offers robust out-of-the-box features, deep customization, proven scalability, and immediate value, saving organizations the time and resources required for custom builds. Its mature analytics and actionable insights deliver rapid ROI, and its enterprise-grade security and compliance reduce risk compared to lengthy internal development projects. Source

    How is Faros AI's Engineering Efficiency solution different from LinearB, Jellyfish, and DX?

    Faros AI integrates with the entire SDLC, supports custom deployment processes, provides accurate metrics from the complete lifecycle of code changes, and delivers actionable insights tailored to each team. Competitors are limited to specific tools and offer less customization and actionable recommendations. Source

    What makes Faros AI suitable for enterprise procurement?

    Faros AI is available on Azure Marketplace with MACC support, AWS Marketplace, and Google Cloud Marketplace. It meets enterprise procurement requirements with compliance certifications and robust security. Source

    How does Faros AI support developer experience integration?

    Faros AI provides in-workflow insights, direct integration with Copilot Chat for PRs and tasks, and ready-to-go developer surveys with AI-powered summarization, enabling continuous feedback and improvement. Source

    Product Information & Resources

    Where can I read more blog posts from Faros AI?

    You can read more blog posts at https://www.faros.ai/blog.

    What kind of content is available on the Faros AI blog?

    The Faros AI blog features content on developer productivity, customer stories, guides, news, and best practices. Key topics include engineering productivity, DORA metrics, and software development lifecycle. Source

    What is the focus of the article 'How to Get a Holistic Understanding of the Developer Experience'?

    The article discusses the importance of blending survey and system data to measure and improve developer productivity and experience, highlighting Faros AI's approach and platform capabilities. Source

    Where can I find information on getting a holistic understanding of the developer experience?

    You can find information in the article How to Get a Holistic Understanding of the Developer Experience and on the Developer Experience page.

    How can I contact Faros AI for a demo or support?

    You can request a demo or contact support by filling out the form on the webpage or visiting the Contact Us page.