This week, I had the pleasure of attending NVIDIA's annual GPU Technology Conference (GTC) in San Jose. (AKA The Woodstock of AI) The experience was (mostly) enlightening, offering a deep dive into the current state and future potential of GenAI technologies. Here's a recap of my key takeaways and the emerging trends from the conference.

Prevalence of AI and Predictive Models 

The conference showcased the dominance of AI and predictive models in today's technological landscape. From its origins in enhancing video game experiences, AI has now permeated a broad array of applications, hardly leaving room for its initial use cases. (sorry game nerds) The shift in focus underscores a significant transformation, indicating a GPU-powered acceleration in our understanding of the market dynamics. 

Key Highlights 

• Keynote Insights: Jensen Huang, NVIDIA's CEO, delivered a compelling keynote to a packed SAP Center, despite noticeable nerves. He introduced the Blackwell GPU, a significant advancement over the existing Hopper architecture, promising revolutionary capabilities in both training and inference phases of AI model development. Jensen's emphasis on "generation" over "inference" aimed to redefine industry terminologies, reflecting the predictive essence of these technologies. His discussion spanned a variety of applications, from medical research in molecule development to weather prediction and aiding visually impaired individuals. 

• The Exhibit Hall Experience: The conference showcased an impressive array of vendors spanning physical infrastructure (including chips, memory, and computing racks), GPU infrastructure software, applications leveraging GPU for predictive modeling (such as vision and language models), cloud services, and foundational software for building and delivering language models, including vector databases and retrieval-augmented generation (RAG) technologies. 

Industry Perspectives 

• Unstructured Data Utilization: The presence of companies specializing in core technologies like vector databases highlighted the critical importance of preparing and making unstructured data searchable to leverage generative AI effectively. I think Vastdata spent its last funding round on their booth property. :) 

• The Rise of Open-Source Language Models: The landscape for language models is evolving, with open-source alternatives gaining traction alongside proprietary offerings from giants like OpenAI and Microsoft’s OpenAI. This shift indicates a growing preference for customizable, closed systems in some sectors, supported by tools like NVIDIA's AI Workbench and Dataiku. 

• Specialized Applications of Generative AI: There was a noticeable focus on companies delivering specialized generative AI solutions, understanding the nuanced needs of their application contexts. From vision and text analysis to business intelligence and enterprise search, companies like Quantex.ai and Glean.com are ones to watch. 

• Engagement Beyond Tech: The conference's attendee demographics hinted at a gap in participation from traditional industries, suggesting a need for broader educational outreach to integrate AI technologies outside the tech sector effectively. 

Noteworthy Companies 

• Dataiku.com: The emergent leader in data science platforms, showcasing its LLM Mesh capabilities. The booth was a little underwhelming.  

• Datarobot.com: Highlighted significant and needed updates, including enhanced notebook integration and language model support. 

• Clear.ml: Presented as an affordable data science platform alternative with less integration complexity. 

• Domino.ai: Showcased as a code-centric tool for deploying AI across various infrastructures. Haven’t heard from these folks in a while.  

• Snowflake.com: Made strides with its "Cortex" suite, focusing on document search and SQL co-pilots within structured data environments. Still a little fragmented for me, but getting cleaner.  

• Brev.dev: Stood out for its quick GPU-enabled notebook setups, emphasizing ease of sharing and building code. Stoked on these guys.  

• NVIDIA AI Workbench: Introduced a seamless solution for transitioning work across different computing environments, utilizing git and containers. 

• Unstructured.io: Offered solutions for making text and other unstructured data ready for generative AI applications. (think Fivetran for RAG’s) 

• VAST (vastdata.com): Positioned as a comprehensive system for handling unstructured data in generative AI workflows. 

• Glean.ai: Reimagined enterprise search with a focus on integrating generative AI across organizational data sources. Watch this one.  

• Quantex-ai.io: Showcased its early-stage BI solutions, focusing on generative AI for transactional data analysis and forecasting. 

One more thing......