Siraj Raval - Offline AI on iOS and Android

I compiled a PyTorch AI model to run locally on iOS & Android! This keeps conversations private, free, & data compliant (both GDPR & HIPAA). In this video tutorial, i’ll show you exactly how I did this for my ongoing healthcare project titled Doctor Dignity (previously titled DoctorGPT) so that you can do the same thing for any AI model, particularly Large Language Models. We start by building a simple language model in Python that runs on an Intel CPU, then accelerate it using CUDA for Nvidia GPUs, Metal for iOS GPUs, Vulkan for Android GPUs, and finally the Tensor Virtual Machine for both iOS and Android. We have a lot to GPU Programming cover in this video, comparing and contrasting different GPU programming techniques (computation vs allocation, abstraction vs transformation, stochastic optimization vs gradient based optimization). My next goal is to get a 3 billion parameter model to pass the US Medical Licensing exam and run on mobile devices. Don’t worry if you’re a beginner to all this, just sit back relax and enjoy the ride, I tried to make this as accessible as possible to all developers. Star Doctor Dignity on GitHub: Please Subscribe! That’s what keeps me going. Want more AI/ML education? Connect with me here: X: Instagram: Facebook: Linkedin: Tiktok: @sirajraval Doctor Dignity Original Video: Doctor Dignity iOS app: (Warning: this is a beta with bugs, please do not have high expectations, i promise it will get a lot better next month) I Built a Trading bot with Bing and ChatGPT: I Built a Sports Betting Bot with ChatGPT: I Built a Trading Bot with ChatGPT: Watch ChatGPT Build an AI Startup: Watch ChatGPT Build a Finance Startup: Learn Machine Learning in 3 Months: Join my AI community: