Generating Detection Rules with LLMs
Posted on July 1, 2024
Suppose you are a payment processor handling thousands or millions of payments every day. Some small number of the payments that you process are bound to be fraudulent. How can you spot them? This problem - identify a small number of bad events in a sea of good events -...
[Read More]
Tags:
Classification, Machine Learning, Artificial Intelligence
Making (Correct) Decisions with Data
Posted on June 27, 2024
Sloppy analytics can lend false confidence to bad decisions. Leaders who understand a few common pitfalls can make better decisions from data. The most common pitfall is underspecification. The answer to a simple-seeming question like “are users more likely to churn if they see more than 3 ads on their...
[Read More]
Tags:
Engineering, Leadership, Data Science
Technical Inspection
Posted on June 17, 2024
The CEO needs to increase company margins. He turns to the engineering leadership team to help. Engineering leadership puts together a sound plan. First the objective to “Increase Company Margins” is decomposed into a collection of eng-level goals like “Reduce Tier 2 Support Hours”. Each of these eng-level goals decompose...
[Read More]
Tags:
Engineering, Leadership, Architecture, Management
Good Engineering Leadership
Posted on November 13, 2023
I’ve spent a lot of time leading large and small engineering teams over the last decade. Through this experince I’ve developed some opinions about what good leadership looks like. My central leadership tenets are: Set a Strategy Do Row-Level Inspection Set Clear Expectations Give Frequent Feedback Let Builders Build Set...
[Read More]
Tags:
Engineering, Leadership, Management
Taming Large Language Models
Posted on May 15, 2023
Generative large language models (LLMs) like ChatGPT are like wild beasts. They are powerful but difficult to tame. One formidable challenge lies in the cost and latency associated with these models. Compared to traditional software solutions, LLMs can operate at a slower pace, incurring higher costs along the way. Instead...
[Read More]
Tags:
Machine Learning, Machine Learning Systems, ML, Large Language Models, GPT