Code Together

Ralph De Wargny, Director of the Intel Liftoff for Startups joins Tony to discusshow this program is enabling startups around the world to bring innovation to lifethrough engineering support, go to market opportunities and business support. They also talk about previous conferences where Intel Liftoff members have been highlighted for their work. Guest: Ralph De Wargny - Direct of Intel Liftoff for Startups Ralph De Wargny Resources: Intel® Liftoff for Startups https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.html Intel® Tiber™ Developer Cloud https://www.intel.com/content/www/us/en/developer/tools/devcloud/services.html Christoph Schuhmann TED talk https://www.youtube.com/watch?v=RJ-NbuRj5OU

Tony is joined by Nathan Odle to talk about how he takes consumer hardware and puts together systems to do fun AI tasks. He has built systems using 7x NVIDIA 4090 and 7x Intel Arc A770. Come here about his experience building the systems and using the software to solve real problems and squeeze maximum performance out of GPUs you can buy yourself. Guest: Nathan Odle is an engineer, rally racer, and AI enthusiast who enjoys combining cutting-edge technology with practical applications. In the pursuit of backprop, Nathan recently built a custom AI server using seven Intel Arc A770 graphics cards, showcasing how consumer hardware can be used for advanced AI tasks. You can learn more about how to build your own on his website: http://mov-axbx.com Nathan Odle Resources: Nathan's X https://x.com/mov_axbx Intel® Arc™ A770 GPU https://www.intel.com/content/www/us/en/products/details/discrete-gpus/arc.html Intel Extension for PyTorch https://github.com/intel/intel-extension-for-pytorch

Quality of content and the web can be extremely challenging. Is the quality and civility of the content appropriate? Seekr is using AI to determine that for you as a business. They also are able to extend their learnings to help businesses build better LLMs for their own custom usages. Stefanos Poulis, Chief of AI Research and Development, joins us to discuss how to build LLMs that measure civility or any other characteristic of a piece of content. He also talks about how they are exposing their capabilities to allow other businesses to do the same based on their own criteria Guests: Stefanos Poulis Rahul Nair Learn More: Seekr https://www.seekr.com/ Intel® Liftoff for Startups https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.htm Intel® Tiber™ Developer Cloud https://www.intel.com/content/www/us/en/developer/tools/devcloud/services.html Intel® Gaudi® Al Accelerators https://www.intel.com/content/www/us/en/products/details/processors/ai-accelerators/gaudi-overview.html

As AI applications become more prevalent, one of the biggest challenges is efficiently and cost effectively deploying your AI solution. For some it is as simple as following whatever pricing model a backend API SaaS from Google or OpenAI charges. But for others who are looking to deploy their own solutions, this can be challenging. By leveraging inefficiencies in the cloud compute market, NodeShift is making compute resources accessible to a wider range of businesses. Guest: Mihai Mărcuță is an Oxford University data science alumni with a professional background from Microsoft (Azure), Twitter (X), Epic Games (Fortnite) and Cisco. He co-founded NodeShift two years ago with Andrey Surkov. Mihai Mărcuță Resources: Nodeshift http://nodeshift.com Intel Tiber Developer Cloud https://www.intel.com/content/www/us/en/developer/tools/devcloud/services.html Intel Tiber Developer Cloud Blog https://community.intel.com/t5/Blogs/Tech-Innovation/Artificial-Intelligence-AI/AI-Cloud-for-Everyone-Nodeshift-Leverages-the-Intel-Tiber-Cloud/post/1598332 Intel Ignite https://intelignite.com Intel Liftoff for Startups https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.html

Scott Parker joins Tony to discuss the progress getting applications running on Aurora Supercomputer nodes. From 2022 where the project started to today, significant progress has been made using a variety of programming models. Kokkos, OpenMP and oneAPI have enabled migration of scientific and AI applications to run on the Intel CPUs and GPUs Aurora is built on. Guest: Scott Parker is the Lead for Performance Tools and Programming Models at the ALCF. He received his B.S. in Mechanical Engineering from Lehigh University, and a Ph.D. in Mechanical Engineering from the University of Illinois at Urbana-Champaign. Prior to joining Argonne, he worked at the National Center for Supercomputing Applications, where he focused on high-performance computing and scientific applications. At Argonne since 2008, he works on performance tools, performance optimization, and spectral element computational fluid dynamics solvers. Scott Parker Resources: Aurora Super Computer - https://www.alcf.anl.gov/aurora Intel Data Center Max GPU - https://www.intel.com/content/www/us/en/products/details/discrete-gpus/data-center-gpu/max-series.html Intel Xeon Processors - https://www.intel.com/content/www/us/en/products/details/processors/xeon.html Intel oneAPI Base Toolkit - https://www.intel.com/content/www/us/en/developer/tools/oneapi/base-toolkit.html

Eduardo joins Tony to talk about the latest news from OpenAI with GPT-4o and Google I/O with Gemini. They also talk about who needs a large context windows and do developers benefit from these context windows getting larger. Finally they discuss whether a larger context window can address the same issues as RAG or other solutions. Guest: Eduardo Alvarez - AI Solutions Engineer @ Intel Eduardo Alvarez Links: OpenAI https://openai.com Google I/O https://io.google/2024/ Eduardo's RAG E-Book https://www.linkedin.com/feed/update/urn:li:activity:7188539670400565249/ Intel on AI Podcast https://podcasts.apple.com/us/podcast/intel-on-ai Follow Ryan Carson and check out our X Space 9AM PST M/W/F https://twitter.com/ryancarson

EpochZero and Bilic join Tony to discuss their experience last year in the Intel Liftoff Hackathon for African AI Startups. They talk about how to get the most out of a hackathon as well as the benefits they got from participating in this particular hackathon. Intel supports startups through a variety of program. Hear about how Intel Liftoff Hackathon for AI Startups is supporting innovation on the African Continent. Also learn about a variety of programs, initiatives and collations driving deep tech in Africa. Guests: Mayowa Abejirin is an impact-driven techpreneur whose main interests are in building robotics systems and engineering AI (computer vision and language) algorithms to solve some of Africa's most pressing issues. Dr. Kenneth Aguh is a medical doctor and radiologist and data scientist who is passionate about bring technology advancements into healthcare. Saminu Salisu is a Certified Software Developer and the technical founder of Bilic. He is a PhD candidate at TU Wien with a research focus in Data Engineering and holds a master's degree in Electronic Security and Digital Forensics. Mayowa Abejirin Dr. Kenneth Aguh Saminu Salisu Resources: EpochZero https://epochzero.xyz Bilic https://bilic.io Intel® Liftoff Hackathon for African AI Startups https://airtable.com/apphzz2omOZhalJDw/pagjhWl13D0jE2hnU/form ModusAfrica https://modus.vc Intel® Tiber™ Developer Cloud https://cloud.intel.com

Dr. Bienvenu Soglo joins Tony to discuss the challenges of deep tech AI start up in Africa, and how the second annual Intel Liftoff Hackathon for AI Startups is helping to bridge some of those gaps. They also discuss supporting the African continent to foster innovation. Intel supports startups through a variety of program. Hear about how IntelLiftoff Hackathon for AI Startups is supporting innovation on the African Continent. Also learn about a variety of programs, initiatives and collations driving deep tech in Africa. Guests: Dr Bienvenu Soglo Resources: Intel® Liftoff Hackathon for African AI Startups https://airtable.com/apphzz2omOZhalJDw/pagjhWl13D0jE2hnU/form ModusAfrica https://modus.vc Um6P Mohammed VI Polytechnic University https://um6p.ma/en Prosper Africa https://www.prosperafrica.gov iZET Hub https://izet.zetech.ac.ke Open Startup https://www.linkedin.com/company/open-startup-international/ FAST Accelerator https://www.fastaccelerator.com Innov8 Hub https://www.innov8hub.ng N50 Project https://www.n50project.org

Rahul Nair joins Tony to discuss how Generative AI is changing how innovators innovate and how this shows up in the many hackathons Intel Liftoff for Startups participates in. Generative AI enables immediate value creation from ideas. From creating UIs from drawings and building backend solutions in hours instead of months, GenAI is changing how we build solutions. Guests: Rahul Nair Learn More: Intel® Liftoff for Startups https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.htm Intel® Developer Cloud https://www.intel.com/content/www/us/en/developer/tools/devcloud/services.html Intel® Data Center GPU Max Series https://www.intel.com/content/www/us/en/products/details/discrete-gpus/data-center-gpu/max-series.html Hugging Face https://huggingface.co/ Intel® Liftoff for Startups https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.htm Intel® Developer Cloud https://www.intel.com/content/www/us/en/developer/tools/devcloud/services.html Intel® Data Center GPU Max Series https://www.intel.com/content/www/us/en/products/details/discrete-gpus/data-center-gpu/max-series.html Hugging Face https://huggingface.co/ LA Hacks https://lahacks.com/home

Ben Asaf, CTO and Co-Founder of CLIKA, joins Tony to talk about bringing AI solutions to every device through various technologies that optimize models while retaining high levels of accuracy. They also talk about the future of artificial intelligence software and hardware and how AI may need to change to really impact more users. Find this video podcast and others on the Intel Software Channel on YouTube! https://www.youtube.com/@IntelSoftware/podcasts Guest: Ben Asaf - CTO/Co-Founder of CLIKA Ben Asaf Learn more: CLIKA: https://www.clika.io Intel Ignite: https://intelignite.com Intel® Core™ Ultra Processors: https://www.intel.com/content/www/us/en/products/details/processors/core-ultra.html Intel Gaudi AI Processors: https://habana.ai

David Berenstein joins Tony to discuss how Argilla is scaling LLM AI solutions. They touch on how Argilla's end to end solutions simplify deploying LLMs in practice using their open source stack. They also talk about how they are taking advantage of Intel Developer Cloud and Intel Gaudi AI Accelerators. They also talk about how open source based software companies support their customers. Find this video podcast and others on the Intel Software Channel on YouTube! https://www.youtube.com/@IntelSoftware/podcasts Guest: David Berenstein - Developer Advocate Engineer @ Argilla David Berenstein Learn more: Argilla https://argilla.io Intel® Liftoff for Startups https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.html Intel® Developer Cloud https://cloud.intel.com Intel Gaudi AI Accelerators https://habana.ai Hugging Face Spaces https://huggingface.co/spaces Intel® Geti™ https://geti.intel.com

Markus and Florian of Starwit Technologies join Tony to talk about how AI can make our cities smarter using existing infrastructure. They also talk about how AI is changing the development process and the rapidly changing AI landscape. Guests: Markus Zarbock - CEO/CoFounder Starwit Technologies Florian Stanek - Technical Lead CoFounder Starwit Technologies Markus Zarbock Florian Stanek Learn more: Starwit Technolgoies https://starwit-technologies.de/ Intel® Liftoff for Startups https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.html Intel® Xeon® CPU Max Series https://www.intel.com/content/www/us/en/products/details/processors/xeon/max-series.html

Jonas Menesklou, CEO of AskUI joins Tony to talk about how Generative AI is changing the way startups and developers compete in a rapidly changing world powered by AI solutions. They also discuss how human computer interaction will be affected by AI and how AskUI is helping enterprises streamline and test their workflows. Jonas Menesklou CEO of AskUI Jonas Menesklou Learn more: AskUI https://askui.com Intel Liftoff for Startups https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.html AskUI Prompt to Text model https://huggingface.co/AskUI/pta-text-0.1 Top 2024 Trends from Our Intel Liftoff members Trends in AI 2024

In Part 2 of the 2024 AI Trends to Watch podcast, Rahul and Ryan join Tony to talk about how Generative AI is affecting society, and strategies to ensure secure and productive AI solutions. They also talk about the current state of AI code generation tools and whether such solutions are ready to replace developers. Guests: Rahul Nair Ryan Metz Learn More: GitHub Copilot https://github.com/features/copilot Intel Real-Time Deepfake Detector https://www.intel.com/content/www/us/en/newsroom/news/intel-introduces-real-time-deepfake-detector.html Intel® Liftoff for Startups https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.htm Intel® Developer Cloud https://www.intel.com/content/www/us/en/developer/tools/devcloud/services.html Intel® Core™ Ultra AI PC https://www.intel.com/content/www/us/en/products/docs/processors/core-ultra/ai-pc.html Intel® Data Center GPU Max Series https://www.intel.com/content/www/us/en/products/details/discrete-gpus/data-center-gpu/max-series.html

Rahul and Ryan join Tony to talk about the top trends in AI that startups in the Intel Liftoff for Startups program see coming. From multi-modal AI models to commoditization of LLM APIs, they discuss what to look out for in 2024. Guests: Rahul Nair Ryan Metz Learn More: Intel® Liftoff for Startups https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.htm Intel® Developer Cloud https://www.intel.com/content/www/us/en/developer/tools/devcloud/services.html Intel® Data Center GPU Max Series https://www.intel.com/content/www/us/en/products/details/discrete-gpus/data-center-gpu/max-series.html Hugging Face https://huggingface.co/ The Mango Jelly https://themangojelly.com/ Sitemana https://sitemana.com/ Genmo https://www.genmo.ai/ Prediction Guard https://www.predictionguard.com/ Argonne Leadership Computing Facility - Aurora https://www.alcf.anl.gov/aurora

Asaf Ezra joins Tony to discuss the benefits of Granulate how it can help improve the performance and reduce your cloud consumption without code changes. They also talk about how Generative AI is changing the landscape of businesses and society. Guest: Asaf Ezra - CEO of Granulate Asaf Ezra Learn more: Granulate https://granulate.io InTechnology Podcast with Asaf Ezra hosted by Camille Morhardt https://youtu.be/0qfx2fq_lV4?si=Y3VFymQUoJWDObiw Databricks and Photon https://www.databricks.com/ https://www.databricks.com/product/photon Gluten https://github.com/oap-project/gluten Spark https://spark.apache.org/ Kubernetes https://kubernetes.io Llama 2 https://ai.meta.com/llama/ OpenAI https://openai.com Mixtral Model https://mistral.ai/news/mixtral-of-experts/

Eduardo Alvarez joins Tony to talk about how the AI landscape for businesses and developers is changing rapidly, and how we need to move to take advantage of the opportunities and not get left behind. They also talk about fine-tuning Llama2 with LoRA on Gaudi2 and the benefits for users. Guest: Eduardo Alvarez - AI Solutions Engineer @ Intel Eduardo Alvarez Learn more: Eduardo's blog post https://medium.com/@eduand-alvarez/a-case-for-operational-centric-ai-6e97dfa4fc23 oneAPI https://oneapi.io https://www.intel.com/content/www/us/en/developer/tools/oneapi/overview.html Unified Acceleration Foundation https://uxlfoundation.org/ Bob Duffy Stable Diffusion https://www.youtube.com/watch?v=pF6DiktPsaA Llama2 Fine-Tuning with Low-Rank Adaptations (LoRA) on Gaudi 2 Processors https://eduand-alvarez.medium.com/llama2-fine-tuning-with-low-rank-adaptations-lora-on-gaudi-2-processors-52cf1ee6ce11 President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence https://www.whitehouse.gov/briefing-room/statements-releases/2023/10/30/fact-sheet-president-biden-issues-executive-order-on-safe-secure-and-trustworthy-artificial-intelligence/

Darryl Adams joins Tony to talk about how generative AI solutions will change the way we interactive with technology. They talk about how to extend current solutions, and how developers and technologists might design better solutions leveraging generative AI capabilities. Guest: Darryl Adams - Director of Accessibility at Intel. Darryl Adams Resources: Goodmaps https://goodmaps.com Ximira https://www.ximira.org BeMyEyes https://bemyeyes.com OpenAI https://openai.com OmniBridge https://omnibridge.ai Cephable https://cephable.com Check out more Intel podcasts at: https://www.intel.com/podcasts

Advancements in genomics have accelerated significantly over the past few decades as compute technology has grown exponentially. Professor Alessandra Ilic and Ricardo Nobre join Tony to talk about their research and how oneAPI is helping them accelerate research in the area of epistasis detection, which in genetics is when the effect of a gene or set of genes is affected by the presences or absence of another set of genes. Guests: Aleksandar Ilic is an Assistant Professor at the IST, University of Lisbon, and a Researcher of INESC-ID, Portugal. His research interests include high-performance and energy-efficient computing and modeling of parallel heterogeneous systems. Ricardo Nobre is a PostDoc researcher at the INESC-ID R&D center in Lisbon/Portugal, as part of the High-Performance Computing Architectures and Systems (HPCAS) research area. His interests include high-performance computing, parallel programming, compilers and machine learning. Aleksandar Ilic Ricardo Nobre Resources: INESC-ID Achieves 9x Acceleration for Epistasis Disease Detection using oneAPI Tools and Intel Hardware https://www.intel.com/content/www/us/en/developer/articles/case-study/inesc-id-9x-acceleration-for-disease-detection-app.html?wapkw=inesc Source Code https://github.com/hiperbio Intel® Advisor https://www.intel.com/content/www/us/en/developer/tools/oneapi/advisor.html Intel® VTune™ Profiler https://www.intel.com/content/www/us/en/developer/tools/oneapi/vtune-profiler.html oneAPI https://oneapi.io https://www.intel.com/content/www/us/en/developer/tools/oneapi/overview.html 4th Gen Intel® Xeon® Scalable processors Intel® Data Center GPU Max Series References: D. Marques, R. Campos, S. Santander-Jiménez, Z. Matveev, L. Sousa and A. Ilic. Unlocking Personalized Healthcare on Modern CPUs/GPUs: Three-way Gene Interaction Study. Paper presented in the 36th IEEE International Parallel & Distributed Processing Symposium (IPDPS) Lyon, France, 2022. DOI: 10.1109/IPDPS53621.2022.00023 R. Nobre, A. Ilic, S. Santander-Jiménez and L. Sousa. Fourth-Order Exhaustive Epistasis Detection for the xPU Era. Paper presented in the 50th International Conference on Parallel Processing (ICPP), Chicago, USA, 2021. DOI: 10.1145/3472456.3472509 D. Marques, A. Ilic, Z. A. Matveev, and L. Sousa. Application-driven Cache-aware Roofline Model. Future Generation Computer Systems 107 (2020): 257-273. DOI: 10.1016/j.future.2020.01.044 Ilic, F. Pratas, and L. Sousa. Cache-aware roofline model: Upgrading the loft. IEEE Computer Architecture Letters 13.1 (2013): 21-24. DOI: 10.1109/L-CA.2013.6 Check out more Intel podcasts at: https://www.intel.com/podcasts

Eduardo Alvarez joins Tony to talk about using open large language models (LLMs) to compete with closed source alternatives isn't as hard as one may think. He also talks about how the industry is changing around AI solutions with the popularity of open models thanks to companies like Hugging Face and the GPT4All community. Eduardo then talks about his experience running hackathons and the brand new Intel Developer Certification program, which he created the MLOps content for. Finally they wrap up with a discussion about his journey as a LatinX engineer celebrating Hispanic Heritage Month. Guest: Eduardo Alvarez - AI Solutions Engineer @ Intel Eduardo Alvarez Learn more: Hugging Face https://huggingface.co/ GPT4All https://gpt4all.io OpenVINO Toolkit https://www.intel.com/content/www/us/en/developer/tools/openvino-toolkit/overview.htm Intel Neural Compressor https://www.intel.com/content/www/us/en/developer/tools/oneapi/neural-compressor.html Intel® Extension for Transformers https://github.com/intel/intel-extension-for-transformers Intel® Neural Compressor https://www.intel.com/content/www/us/en/developer/tools/oneapi/neural-compressor.html Intel® Developer Cloud https://cloud.intel.com oneAPI https://oneapi.io