Mathematics w/ Donut AI and Nougat AI - Swin Transformer

Mathematical formulas in PDF or images are lost to AI summarization. No AI, LLM or ViT can correctly interpret from a PDF any mathematical formulae. Visual Document Understanding (VDU). Therefore I recommend to upload the LaTeX file of an arxiv preprint to GPT-4 Code Interpreter for a detailed mathematical understand of complex relations in Physics, biology, chemistry, medicine, architecture, finance, economy, ... Swin ViT (Vision Transformers) are the solution for mathematical formulae recognition, first implemented in Donut AI, then with a special focus on maths and tables with Nougat AI. All rights with authors of: OCR-free Document Understanding Transformer (DONUT): #ai #pdf #mathematics