Engineering Log
The Neural Notebook
Exploring the frontiers of Artificial Intelligence. Thoughts on NLP, Computer Vision, and large-scale System Design.
October 24, 2023 •
System DesignNLPEdge AI
Optimizing Transformers for Edge Devices
Deploying large language models on mobile and IoT devices requires careful quantization and pruning. Here is a breakdown of techniques to reduce latency without sacrificing accuracy.
Read Article →
September 12, 2023 •
OpinionEthicsGenAI
The Ethics of Generative AI
As generative models become ubiquitous, we must address the bias inherent in training data. A look into the societal impact of AI.
Read Article →