Technical Inspection

The CEO needs to increase company margins. He turns to the engineering leadership team to help. Engineering leadership puts together a sound plan. First the objective to “Increase Company Margins” is decomposed into a collection of eng-level goals like “Reduce Tier 2 Support Hours”. Each of these eng-level goals decompose... [Read More]
Tags: Engineering, Leadership, Architecture, Management

Good Engineering Leadership

I’ve spent a lot of time leading large and small engineering teams over the last decade. Through this experince I’ve developed some opinions about what good leadership looks like. My central leadership tenets are: Set a Strategy Do Row-Level Inspection Set Clear Expectations Give Frequent Feedback Let Builders Build Set... [Read More]
Tags: Engineering, Leadership, Management

Taming Large Language Models

Generative large language models (LLMs) like ChatGPT are like wild beasts. They are powerful but difficult to tame. One formidable challenge lies in the cost and latency associated with these models. Compared to traditional software solutions, LLMs can operate at a slower pace, incurring higher costs along the way. Instead... [Read More]
Tags: Machine Learning, Machine Learning Systems, ML, Large Language Models, GPT

Using Large Language Models to Solve your Problems

Generative large language models (LLMs) like ChatGPT will revolutionize the way we approach complex problems. Enormous amounts of custom labeled data are no longer required to train many specialized AI systems. LLMs make generalized problem-solving capabilities vastly more accessible. This has profound implications for software development, data science, and machine... [Read More]
Tags: Machine Learning, Machine Learning Systems, ML, Large Language Models, GPT

One Quick Trick to Increase ML Engineer Productivity

ML models are collaboration bottlenecks. Suppose your team owns a binary classification model, and you have decided that increasing this model’s recall without reducing precision is very important for the business. You’ve put 5-10 engineers on the job. The Problem What should these engineers do? There are many ways to... [Read More]
Tags: Machine Learning, Software Engineering, ML Engineering