Aditya Dewan

Aditya Dewan

About

Quantitative finance and machine learning researcher focused on statistical modeling of financial markets, efficient transformer architectures, and loss-landscape-based knowledge distillation. Aspiring deep learning researcher working towards mastery in the field.

Education

B.S. Computer Science, Mathematics Minor, Machine Learning Concentration Carnegie Mellon University
May 2028
Pittsburgh, PA

Clubs: Quant Club (Goldman Sachs Quantathon: 100%), CMU Racing (built CUDA SVMs for 2x speedup). ACT 36.

Systems Work: Built Malloc (heap allocator), a Blackwell-optimized GEMM kernel, and a concurrent thread-safe file system from scratch.

Gifted Program The Woodlands Secondary School
Sep. 2020 – Jun. 2024

Selected Coursework

Machine Learning & Systems: 10-723 Generative AI (Ph.D.), 11-785 Deep Learning (Ph.D.), 10-701 Machine Learning (Ph.D.), 15-442 Machine Learning Systems (GPU + Kernel Optimization), 15-210 Parallel Computing + Algorithms, 15-213 Introduction to Computer Systems, 15-122 Data Structures and Algorithms, 15-150 Functional Programming
Math, Theory & Quantitative: 15-259 Probability and Computing, 21-270 Mathematical Finance, 15-251 Theoretical Computer Science/Discrete Math, 15-195 Competitive Programming, 21-241 Matrices and Linear Algebra, 21-295 Putnam Seminar

Research & Experience

Research-heavy ML work and production systems engineering across long-context modeling, diagnostics, and high-reliability infrastructure.

Software Development Engineer Intern (Return offer received) Amazon Web Services (AWS), Display Protocols Team
May 2026 – Aug. 2026
Seattle, WA
  • Designed a Poisson-process packet-loss probe scheduler with provable guarantees: modeled exponential probe inter-arrivals and cast repeated-anomaly detection as a geometric process, setting the probe rate for at least 95% detection within 7 recurrences; truncated the heavy exponential tail via a Chernoff bound solved with the Lambert W function, provably preserving 95% of the sampling mass while eliminating unbounded waits.
  • Built a real-time C#/.NET diagnostics client (STA/MTA multithreading, async probes, rotating ndjson sessions) streaming 51 live client metrics; embedded statistical suite (Gaussian fitting, pairwise correlation heatmaps, scatter/histograms, session replay) saves roughly 598 cumulative hours of production troubleshooting time; integrated and shipped metric samplers into Amazon WorkSpaces (now in production) for clients including Ferrari, Intuit, Netflix, and Volkswagen.
  • Architected an end-to-end anomaly detection and time-series forecasting ML pipeline: built synthetic data generation and validation infra injecting CPU/GPU/RTT anomalies, fine-tuned a Tiny Time Mixer with anomaly-detection and forecasting heads plus stream-pooling; added root-cause diagnostics and troubleshooting suggestions via a routing layer; entirely on-device inference and training with near-zero CPU client cost, augmented via hysteresis and debounce.
Machine Learning Research Intern Goomba Lab (Inventors of Mamba Architecture), Carnegie Mellon
May 2025 – Aug. 2025
Pittsburgh, PA
  • Implemented a novel skip-connection Mamba model eliminating MHA-based retrieval degradation in SSMs; diagnosed Mamba-2 gather-aggregate bottlenecks on MMLU via embedding perturbation and eigenspace projection analysis, enabling efficient linear-time LLMs.
Machine Learning Research Intern School of Computer Science, Carnegie Mellon (Dr. David Touretzky)
Jul. 2023 – Aug. 2024
Pittsburgh, PA
  • Built a React web app simulating textual Markov Chain models for 900+ professionals worldwide; co-credited creator, cited in multiple ACM/CHI publications on AI literacy education (demo).
  • Automated graph generation and n-gram estimation over Wikipedia-scale corpora via dynamic rendering and caching.
Award-Winning Neural Network Compression Algorithm (SPRKD) Regeneron ISEF
Aug. 2022 – Aug. 2024
Dallas, TX
  • Devised a novel knowledge distillation algorithm at 16 achieving 94.8% accuracy on a 6,430-parameter malaria-classification CNN, beating standard distillation by 24.7 points (p = 6.3e-87); also delivered 2-24% accuracy gains in as little as 10% of training time across MNIST, CIFAR-100, and TinyImageNet.
  • Reframed distillation from output-replication to using weak-teacher ensembles as curvature/domain proxies via Hessian eigenvalue spectral density, aggregated into an Approximated Saddle Region and injected into the student for re-exploration of low-loss saddle regions. PyTorch, PyHessian, NumPy. Awarded by NSA, ISEF, WAICY.
  • Published as arXiv:2607.23346; ISEF project page.
Junior Machine Learning Engineer The Rounds (Boondoc Technologies, $40M healthcare startup)
Jul. 2023 – Jan. 2024
Toronto, CA
  • Architected the company's ML infrastructure (prompt-chunking, novel drug-vector embeddings for medical-grade outputs); deployed an EC2 few-shot LLM drug-monograph summarization API and React app for in-clinic patient diagnosis. Python, Flask, ChromaDB, LangChain.
Machine Learning Specialist (Promoted from Machine Learning Intern) Actionable.co (used by 1000+ organizations)
Jul. 2021 – May 2023
Toronto, CA
  • Led a team of 3 shipping a recommendation-engine API to 45K clients computing principal levers of average-rating-change maximization for firm training programs; engineered a hybrid GAN / Gradient-Boosted Tree / MLP ensemble for production.

Honors and Awards

Selected recognitions across quantitative trading, machine learning research, and international science competitions.

Optiver Market Making Competition
1st Place, Quantitative Trading Competition; first freshman team to ever win.
Hudson River Trading, Best Use of Quantitative Data Award
Awarded for InsurAI, an ML insurance-pricing prediction platform.
U.S. National Security Agency (NSA)
Second Award, Cybersecurity / Mathematics at Regeneron ISEF (1600+ finalists).
Regeneron ISEF
1 of 8 chosen to represent Canada; Fourth Award, Robotics and Intelligent Machines.
Google DeepMind Offer
Selected as a research contractor as a sophomore (declined due to start date conflict).
TEDx Speaker, Innovire Speaker
Mathematical Foundations of ML, AI Research (linktr.ee/AdiCMU).
Morgan Stanley / Quantbot Trading Competition
Highest Sharpe ratio of all submissions (6th place overall).

Projects

Selected technical projects spanning efficient attention, optimization, and applied ML systems.

Featured
SPRKD (Saddle Point Recruitment for Knowledge Distillation)
2022-2026 | arXiv:2607.23346
Reframes knowledge distillation from teacher replication to curvature transfer, using teacher saddle regions as proxies for loss-landscape structure. Distilling from a weak 2-epoch teacher, SPRKD reaches 94.80% validation accuracy on malaria blood smear classification, outperforming Response KD by 24.70 points (70.10%) and matching scratch-trained controls to statistical equivalence. Hessian spectral analysis shows convergence to substantially flatter minima (trace 33.39 vs. 408.27 for RKD). Recognized by the NSA, ISEF, and WAICY.
SPRKD three-phase pipeline: teacher ensemble training with saddle tracking, saddle region approximation and distillation, and SPRKD student training.
The three-phase SPRKD pipeline: (1) teacher ensemble training with Hessian-based saddle tracking, (2) saddle region approximation and transfer by injection, (3) student training via decaying transformation matrices and negative Hessian eigensteps.
HFOLD: Dynamic Hidden State Heap Folding for Efficient Long-Context Attention
Introduced an inference-time memory mechanism that augments sliding-window attention with a bounded heap of high-relevance historical states. At each timestep, HFOLD retrieves top-ranked hidden states, reinserts transformed high-attention tokens, and applies a relevance-conditioned FOLD update (via GEM + RSM modules) to preserve information from evicted states. On Pythia 14M/31M evaluation, HFOLD recovered substantial long-range quality lost by plain sliding-window attention in language modeling (perplexity reduction from 225.1 to 91.7 in the full-attention-finetuned setting), while maintaining linear-time asymptotic behavior. The main current limitation is systems-level throughput overhead from non-fused heap operations.
Born-Again Neural Networks
Born-Again Neural Networks
From-scratch reproduction of Born-Again Neural Networks with controlled teacher-student experiments to analyze iterative self-distillation behavior.
Adam Optimization
Adam Optimization From Scratch
Clean-room implementation of Adam with detailed instrumentation for convergence diagnostics and optimizer behavior analysis.
Maxout Activation
Custom Maxout Activation Implementation
Numerically stable Maxout implementation and experiments comparing representational behavior against conventional activation families.
Expected Gradient Divergence Weighting (EGDW) for TITANS Memory Updates
2025
Proposed a probabilistic memory-update rule for TITANS using Markov/Jensen bounds to stabilize neural memory writes; achieved improved validation cross-entropy relative to baseline despite higher train loss, indicating stronger generalization.
Autonomous Vehicle Simulator
Autonomous Vehicle Simulator
Behavioral-cloning based autonomous driving stack in simulation, including data collection, model training, and closed-loop trajectory validation.
Symptom Diagnosis AI
Symptom Diagnosis AI
Clinical NLP assistant for symptom triage and patient-facing explanation generation, built as an end-to-end inference API with web integration.
Chess AI
Chess AI
Chess engine prototype with search/evaluation pipeline and iterative model tuning to study strategic depth under constrained compute.
Crysta
Crysta
Student productivity platform MVP centered on non-invasive energy-state estimation, experimentation design, and behavior-adaptive scheduling.

Publications & Articles

Full list available on Google Scholar.

AI Education for the Next Generation: Nurturing K-12 Students
Aditya Dewan, Shanshan Jin, et al. Effective Methods for Teaching Large Language Models (LLMs) to Young Learners. Published on Amazon; peaked at #4 in Neural Networks.
Markov Chain Demo
Aditya Dewan, David S. Touretzky. Carnegie Mellon University, 2023. Co-credited creator; cited in multiple ACM/CHI publications on AI literacy education.
Viewpoint Paper on Knowledge Distillation
Atherma: Solving the Energy Crisis with Nuclear

Talks & Presentations

Mathematical Foundations of ML, AI Research. For all talk links, visit linktr.ee/AdiCMU

TEDx Talk

Innovire Talk

News

Skills

Languages: Python, C, C++, C#, Java, SML, SQL, JavaScript
Frameworks & Technologies: PyTorch, TensorFlow, .NET, Node.js, Flask, React.js, NumPy, Pandas, XGBoost, CUDA, Git

Contact

Pittsburgh, PA | (647) 408-6446 | adewan2@andrew.cmu.edu

Email | LinkedIn | GitHub | Google Scholar | Twitter | Newsletter