Try for free
Event PAST

LLM programming workshop.

28 August Online

Join this event

🎟️ Register / View Event Details

About this event

Review programming fundamentals. Pytorch, HuggingFace apis, The popularity of LLMs has caused extensive copy and paste in open source projects such as vllm. We are going to cover some basic programming idioms needed for distilling models from big to smaller models. These skills are transferrable and are different than the classic RL exercises.
pre distillation exercises

Distillation Transfer Teacher model to student model

You will need a colab account. We will review each problem and leave time for everyone to complete their solutions without the aid of a LLM.
This event is about repetition and practice.

  1. HF apis to tokenizer and model
  2. how to speed up model downloads
  3. basic idioms, batching, padding, attention masks
  4. logits and probability distributions with softmax
  5. minimizing KL divergence
  6. top-k and softening teacher distribution by raising T. Dark Knowledge
  7. token level knowledge distillation. (distillation event we will stop here)
  8. Sequence level distillation
  9. DAgger Ross 2011
  10. Off policy Distillation
  11. On policy Distillation Agarwal 2024
  12. Self Distilled Reasoning Zhao 2016
  13. Self Distillation Fine Tuning Shenfeld 2026

Generated by Codex.
https://colab.research.google.com/drive/1EokTq_U-_JcPHtPTTjfVUcSjTW7dyDiB?usp=drive_link

Want to find AI jobs?

Join thousands of AI professionals finding their next opportunity

We respect your inbox. Unsubscribe at any time.

© 2026 DevFound.ai. All rights reserved.

Common Questions

Frequently asked questions

Quick answers about how DevFound's AI matching, resumes, and referrals work.

DevFound's AI Copilot ingests your profile, goals, and live job data to deliver curated matches in seconds. Every match includes a resume variant, suggested referrals, and interview prep so you can act immediately. The more feedback you provide, the sharper the Copilot becomes.

AI-led job searches shrink the hours spent sifting through boards and formatting resumes. DevFound pairs automation with your personal outreach, so you reserve energy for interviews and negotiation. Traditional networking still matters, but AI gives you a lift before you even send a message.

Modern AI roles expect comfort with production-grade code, data fluency, and practical ML tooling. The strongest candidates pair deep technical chops with storytelling—translating model impact to product, GTM, and exec partners. Continuous learning keeps you ahead as stacks evolve.

DevFound rewards active seekers. Keep your profile fresh, respond to match quality prompts, and enable alerts so you never miss a role. The AI prioritizes companies and teams that align with your feedback, accelerating both introductions and interview invites.

High-density tech hubs continue to host the deepest AI talent pools, yet distributed teams are catching up fast. Use DevFound filters to hone in on onsite, hybrid, or fully remote roles and watch openings expand across time zones.

DevFound aggregates thousands of remote AI openings and flags the nuances—core hours, async culture, and visa needs—up front. The Copilot also recommends how to position your distributed work experience so hiring managers know you can thrive on a remote team.

Still have questions?

Contact Support