Podcast: Bringing the Modern Data Stack to Engineering Operations
The lessons learned from the modern data stack (MDS) come in when building data pipelines to connect data from disparate tools. In this episode, Lars Kamp and Vitaly Gordon discuss about engineering productivity, DORA Metrics, Faros Open-source community edition, and more...
November 17, 2022
In the old world of software engineering, developer productivity was measured by lines of code. However, time has shown how code quantity is a poor measure of productivity. So, how come engineering organizations continue to rely on this metric? Because they do not have a "single-pane" view across all the different systems that have data on various activities that actually correlate with productivity.
That's where Faros AI comes in. Faros AI connects the dots between engineering data sources—ticketing, source control, CI/CD, and more—providing visibility and insight into a company's engineering processes.
Vitaly Gordon is the founder and CEO of Faros AI. Vitaly came up with the concept for Faros AI when he was VP of Engineering in the Machine Learning Group at Salesforce. As an engineering leader, it's not always code; you also have business responsibilities. That meant interacting with other functions of the business, like sales and marketing.
In those meetings, Vitaly realized that other functions used standardized metrics that measure the performance of their business. Examples are CAC, LTV, or NDR. These functions built data pipelines to acquire the necessary data and compute these metrics. Surprisingly, engineering did not have that same understanding of their processes.
An example of an engineering metrics framework is DORA. DORA is an industry-standard benchmark that correlates deployment frequency, lead time, change failure rate, and time to restoration with actual business outcomes and employee satisfaction. For hyperscalers like Google and Meta, these metrics are so important that they employ thousands of people just to build and report them.
So, how do you calculate DORA metrics for your business? With data, of course. But, it turns out the data to calculate these metrics is locked inside the dozens of engineering tools used to build and deliver software. While those tools have APIs, they are optimized for workflows, not for exporting data. If you're not a hyperscaler with the budget to employ thousands of people, what do you do? You can turn to Faros AI, which does all the heavy lifting of acquiring data and calculating metrics for you.
The lessons learned from the modern data stack (MDS) come in when building data pipelines to connect data from disparate tools. In this episode, we explore the open-source Faros Community Edition and the data stack that powers it.
More articles for you
The Faros AI infrastructure leverages a proven modern data stack: Airbyte, Hasura, Metabase, n8n, and dbt — specially customized to handle the nuances of Engineering Operations data. And unlike blackbox solutions, it is designed to grow with the growing needs of your engineering organization. Read On ...
As an engineer at an early-stage startup I wear a lot of different hats. Some days I focus on coding; on others, I focus on designing features and defining the work for our contractors. Read this post to learn more about how I leverage Faros AI to make my job easier.
The 2022 Accelerate State of DevOps Report by Google Cloud’s DevOps Research and Assessment team (DORA) came out just a few weeks ago and the results are honestly quite shocking (or maybe not so after all?) - let’s discuss.
Get started with Faros AI today!
Start your free trial now and get the full picture in minutes.
No credit card required.