AI Pilots Don’t Scale by Accident: Takeaways from Databricks Data + AI Summit 2026

What four days at the Databricks Data + AI Summit taught me about making agentic analytics actually work

I spent this week at DAIS 2026 in San Francisco — four days of sprinting between buildings, conference rooms, and keynote halls to catch as many sessions as possible. I tried my best to get a full picture, not just the headline announcements.

Sessions included Intelligent Document Parsing with Lakeflow, AI Mesh: The Age of AI Products, Your AI Strategy is Only as Good as Your People Strategy, How J&J Medtech and Takeda Scale Data & AI, An Intro to Building & Scaling Agentic Apps, Agentic Analytics on the Databricks Lakehouse, and Latest Innovations in AI/BI for Business Users.

The energy was electric. The keynote session was attended by over 30,000 professionals – I had never been in a room like that before. The demos were impressive. And one slide — almost easy to miss in the middle of a packed breakout session — said something that has stayed with me:

“Most organizations don’t have an AI innovation problem. They have a reuse, governance, and trust problem.”

This diagnosis lands with particular weight in regulated, data-intensive industries like life sciences.

The Pattern We Keep Seeing

Across industries, a common AI adoption story plays out like this: a team identifies a high-value analytics problem, builds something smart to solve it, and sees real results. Then another team does the same — independently, for their own version of essentially the same question. Then another.

Each effort is genuinely useful. Each one also operates in isolation: its own data assumptions, its own logic, its own definition of the metrics that matter. There’s no shared semantic layer — no governed, agreed-upon source of truth that all these efforts draw from. No common framework for what “on track” means, or how performance is measured, or which numbers are approved for which audiences.

The result isn’t a lack of AI capability. It’s a proliferation of disconnected outputs that are difficult to reconcile, expensive to maintain, and nearly impossible to scale across a large user base.

The next use case starts from zero. Again.

This is the AI pilot trap. And based on the sessions I attended – looks like it’s everywhere.

What “Agentic Analytics” Actually Requires

The most useful framing I took away from DAIS came from the session on Agentic Analytics on the Databricks Lakehouse. The presenters used the example of a data anlyst “Jess” and laid out three failure modes with uncomfortable clarity:

Accuracy — Agents lack the semantic grounding to write accurate queries. Ask an agent “what’s our dropout rate in the APAC region this quarter?” and it will give you an answer. Whether that answer matches your function-specific definition of dropout, your certified enrollment table, or your SME-approved denominator — that’s a different question entirely.

Governance — What data and tools are the agents allowed to access? Who approved this agent’s access to a certain table? Can it write to operational dashboards? Does it behave differently depending on who’s asking? Agents access data and tools in ways that weren’t designed for them.

Scale — Agents that work in a pilot cause performance and cost problems at enterprise scale. Lightning-speed query response times and predictable infrastructure costs aren’t luxuries when you’re running analytics across hundreds of trials for thousands of users.

These are the exact failure modes that turn a promising clinical ops AI initiative into a governance escalation.

The Architecture That Changes the Equation

What Databricks laid out — and what I think is genuinely the right pattern for enterprise analytics teams — is a four-layer answer to these three problems:

Compute (Lakehouse RT) — gives you the scalable, cost-efficient foundation. Sub-second responses across large clinical datasets without unpredictable cloud bills.

Governance (Unity AI Gateway) — acts as a single control plane: agent registry, access control, contextual policies, cost budgets, and tracing. One place to govern both data and AI. One place to ask “who approved this?” and get an actual answer.

Semantics (Genie Ontology) — THIS, for me, what the most valuable aspect of the entire conference. It is the piece that made every room lean forward. Rather than each team maintaining their own definitions, you build a shared business ontology — enrollment milestone timelines, regional performance benchmarks, patient dropout criteria — once, in a governed layer, and every agent draws from it. This can be defined based on functional definitions. An agent querying trial performance doesn’t decide what “on track” means. The ontology does.

Agent Choice — deploy through Genie One, custom agents, or MCP endpoints, wherever your users actually work: in MS Teams, in your clinical ops portal, in a mobile dashboard during a site visit.

The phrase from the keynote that stuck: one platform, one identity model, one governance plane.

The Harder Question: Who Owns This?

The most practically useful session I attended was on “AI Products” — not AI features, not AI pilots, but AI products. The framing was simple: the domain owner defines the reusable business capability before the team implements the agent.

In clinical trial operations, that means someone has to own the answer to: what is our certified definition of enrollment rate? What’s the governed source of site dropout data? Which metrics are approved for executive reporting versus investigational use?

That’s not an engineering question. It’s a data leadership question. And the organizations that answer it first — that build once, govern once, and compose many times across their agent ecosystem — are the ones that will turn AI pilots into AI infrastructure.

The ones that don’t will keep rebuilding the same agent, for the same question, on the same data, six months from now.

Dilip Merala is a Data & AI Analytics Manager specializing in clinical trial operational analytics. He attended the Databricks Data + AI Summit 2026 in San Francisco.

Studio City Eats – Uovo is an absolute delight

We visited Uovo for date night on a hunch – last minute plan to drive down (10 mins ) and get in the queue as they don’t take reservations. Since it was closer to 6 pm than 7 pm, we got lucky with just a 15 minute wait. And what a delicious evening it was!

We went for the “Cheese & Truffle tasting” which gave us a Yellowtail crudo appetizer, 3 lipsmacking pastas and a Tiramisu – all BIG HITS! I was apprehensive of the quantity not being sufficient for both of us, but I was wrong. It was PLENTY!

The pasta is flown in daily from Italy, so that’s something! The biggest draw though was sitting at the bar and watching the chefs at work. Front row seats to how the machinery works and how the chefs weave their magic was quite mesmerizing.

My favorite – the Tagliatelle in truflle sauce! MUST GO BACK!

Where are you from?

This simple, disarming ice-breaker often makes me reflect on my identity and origins. My grandparents were farmers and shepherds in the foothills of Tirupathi, Andhra Pradesh in south India. My grandfather moved to Mumbai to work in a mill in the ’40s. My Dad was born in Mumbai and so was I. When I was growing up in Mumbai, since people knew my native tonue wasn’t Marathi- I got the question, “what’s your mother tongue” which was another way of asking where my people came from. The answer, of course, was Telugu and Andhra Pradesh. Then, when I started traveling across India, people asked me again – “Where are you from?” and the answer to them was – “I am from Mumbai”.

I spent most of my life in Mumbai. When I was 32 years old, I moved to the United States in search of better prospects. Studying in Dallas at a university that hosted students from across the globe, I naturally got the question again. My answer then changed from “Mumbai” to “India”. Two years later, I moved to Los Angeles and started working here. I met my wife here and have been calling this place home for almost 6 years now. So now when we travel to other parts of the US or the world, when someone asks me – “where are you from?”…. I take pause. My mind wonders and wanders. What’s the right answer here? Andhra Pradesh? Mumbai? India? Los Angeles?

They are all part of me. I still mostly feel like a Mumbai lad, but Los Angeles is my new home. Thanks to my wife and in-laws, I now feel like I belong here. So my answer these days is “Los Angeles”. And what if someone in LA asks me this question? Nobody here has actually asked me this question 🙂

Cambria and a friendly reunion – March 2025

We had been meaning to get back to Cambria since we got engaged there. Other trips took priority and coming back to Cambria kept getting delayed. Then, the perfect opportunity came along. We hadn’t met my friends Gayatri and Sandeep since our wedding. They live in Northern California so we thought we will split the difference and meet midway in Cambria.

The visit was delightful as always. We stayed at the Sand Pebbles Inn and visited our favorite spots. Getting to spend time with Gayatri and Sandeep was icing on the cake. TIme was spent having breakfast at the Hidden Organic Kitchen and then walking around town exploring some antique stores and charming shops. We went for lunch to the Opollo winery and enjoyed some conforting pizza and wine. Dinner at Robin’s was a treat as usual. And for a change, the next morning we went to the west side of Cambria to have a mimosa brunch at a place called… wait for it… Cambria Mimosas Steak & Seafood.

We bid our goodbyes around lunchtime with the hope and promise that we will see each other again soon!

Best TV shows of 2025 so far

For a while, I have been complaining that there’s a lull in good film and TV content. A few years ago, I remember how there used to be a lot of excitement year after year as people waited in anticipation for a new season of Game of Thrones or The Big Bang Theory. It’s been a while since I have seen such a global frenzy or even shows that make you eagerly wait for the next episode. Until early this year, that is. Since my return from India in January 2025, I have watched some exhilarting stuff making me feel that well-written, well-shot, excellently performed, entertaining content is back in our lives.

It started, of course, with Apple TV’s Severance – an incredible, unique take on work-life balance/imbalance and identity. I’ve been waiting for this one ever since we finished watching season 1 last year and the second season did not dissapoint. 10 episodes went by real quick and I am already waiting for the next one. I did read an article that each episode takes $20 million to make and that makes me think how many more seasons they can sustain. The production house is called ‘Fifth Season Productions’ so may be that’s a hint.

The next one I liked is HBO’s The Pitt – yet another medical drama but nothing like I have ever seen before. I got interested in it as I saw John Wells (of The West Wing fame) was one of the Executive Producers. Heartbreaking at times, this show has a cool cast of actors I am witnessing for the first time (seriously, I have not seen a single one of these actors before and they are wonderful). It’s the story of a day in an emergency room with each episode portraying an hour starting 7 am.

And then there is HBO’s The White Lotus! Returning for season 3 set in Thailand this time, this show is a quirky take on luxury travel and the contrast between the lives of rich people on vacation vs those of the local staff. A couple of our favourites – Amy Lou Wood and Carrie COon – are in this season so that makes it all the more exciting. This shows is lways a cool mix of funny, thrilling and sometimes cringy!

The White Lotus on Max

And finally, the one that blew my mind away is Netflix’s Adolescence. Without giving away much, I can say it’s some of the best performances and cinematography I have seen in… well.. ever! It could be sad (especially for parents) but a stunning experience for actors and writers. It’s one of those thrilling shows that’ll make you sit quietly and think once you are done with it. Shoutout to Owen Cooper, whose performance took my breath away.

I should probably not spend this much time watching TV, no? Time to dive into a book for a bit!

Radio Show – March 2025

I’m all set to appear in another radio show produced by Mary Main Productions. Once again, I am fortunate to voice various characters in 4 stories but especially – detective Nick Charles, solving and preventing crimes with his wife Nora Charles (played by my better half, Summer). This interesting format where actors appear on stage as characters from 1930s radio artists and read from a script has been quite new and revelatory for me. Here’s some marketing material.

Portland Anniversary Trip: A Vineyard, A Lighthouse, and Some Gastronomic Delights

Our anniversary trip to Portland this July turned out to be quite a wonderful experience. It reminded me of Mumbai to Goa getaways back in India, mostly because of the short flight from Los Angeles and the laid-back pace of Portland. It’s always nice when we can fly out of Burbank airport (just 15 mins from home) instead of LAX, which turns into an ordeal due to traffic close to the entrance. Thanks to easy Burbank to Portland flight availability, our travel was absolutely hassle-free.

Portland

The plan for the vacation was simple – spend 3 nights away from the city in Mcminnville in a sprawling vineyard, and then 3 nights in the city of Portland exploring its famous food scene. The Youngberg Hill Vineyard and Inn was in most part a rejuvenating experience with magnificent views from our room and a really cool vineyard with many charming spots to take walks and hang out. A day trip to Cape Meares Lighthouse was a great way to experience the Oregon coast. We even enjoyed the 4th of July fireworks in downtown McMinnville right thorugh the large windows of our glorious Jura room at The Youngberg Inn. Unfortunately, we had to cut our stay at the Inn one day short due to a wasp incident at the Inn and unavailability of staff to help us out. (This changed our rating of the place from 5 stars to 3.5 stars). Nevertheless, Best Western came to our rescue for one night, reminding us that sometimes the simplest of hotels can do a fantastic job of hosting guests and making sure they have a good time. We were still able to keep our dinner reservation at the La Rambla downtown and left for the city the next morning.

ALSO SEE Pacific Grove, Carmel and Solvang – Our first road trip of 2024

Youngberg Hill Vineyard

Our Airbnb stay in Portland was simply PERFECT. The Japanese zen-themed apartment overlooking a green cliff was just marvelous. Thanks to our gracious host, we felt at home right away and the thoughtful, artistic decor in the apartment put us in quite the dilemna – how much time to stay in vs how much time to spend outdoors exploring the city? Thankfully, we didn’t have to plan too much as just going with the flow worked out fine for us.

Cape Meares

Walking up and down the NW 26th Ave and streets around it gave us a good taste of Portland. Food at places like Duck House, Swagat, Papa Haydn was impressive. Our most memorable gastronomic experience was Janken where we had our anniversary dinner. The way the chefs brought out the food and explained each course reminded us of our favorite show, The Bear. The interior of the restaurant was pretty and worthy of a special occasion. Staff was really sweet and professional. Some other aspects of Portland we enjoyed were – taking the stairs to easily go from the top of a hill to a different part of the city, Powell’s books (this book store is huge – takes an entire block), dessert at Papa Haydn, a drive to the Columbia scenic river gorge, visits to some charming coffee shops, and the absolutely stunning and serene Japanese garden.

Historic Columbia River Gorge

All in all – Portland feels like a cute, charming city which doesn’t try to catch up with other big shots. Traffic is manageable, you can relax or got out and have fun as you please, people seem generally happy, weather is considered to be pleasant all year (we did go during a heat wave weekend and were still happy). You have the hills, the ocean, cute houses, great food and drinks, and enough inspiration for a whole TV show that has its own channel now. Can’t ask for much more, no?

CHECK OUT Paso Robles – Our last road trip of 2023

For several years, when I used to back pack across India or take trips with my friends, I used to imagine a time in the future when the woman I love will be with me and we will travel to gorgeous locales around the world. That vision seems to be coming true, one trip at a time. I am living in it now.

My take on George Sluizer’s ‘The Vanishing’

Where I grew up, the meaning of a “horror film” was a movie with several scares, some kind of ghost and/or at least one episode of posession/excorcism. However, according to the Oxford dictionary and my wife (I trust the latter more really), “horror” means an intense feeling of shock, fear or disgust. As such, many films with no ghosts or exorcisms whatsoever fall under this category. On recently learning that Stanley Kubrick claims it’s the most terrifying movie he has watched, we chose ‘The Vanishing’ (“Spoorloos” in Dutch) for our movie night. (Spoliers ahead) We paid $3.99 on Apple TV to rent it and spent a little under two hours experiencing, what I thought, was a brilliant take on a scary abduction.

This actor looks a lot like Anupam Kher

I enjoyed several parts of the film. First, there is no attempt to make it a whodunnit. Quite early on in the movie, you know who did it. And still, the movie kept me engaged and on the edge of my seat. Second, I found the frames and cinematography to be very artistic. Set in France, the film did a pretty good job of giving me a sense of some French locales without making it look touristic. Third, I thought the way music was used in this film was quite interesting. It had a fine blend of silent montages with sporadic instrumental dramatic tunes. It playded well to build up the tension while still doing justice to the artistic shots. Then, the performances were quite impressive – especially Johanna ter Steege as the lively and vulnerable victim. Although I was listening to foreign languages (Dutch and French), their performances transcended the language barrier and I didn’t have to rely too heavily on the subtititles. Finally, what drove it home for me was the excellent use of metaphor. Two golden eggs floating in space. You’ll know it when you watch it.

The Vanishing

We felt a sense of heaviness once we finished watching and I can say that this one will stay with us for a bit. Kudos to the entire team of this wonderful 1988 “horror” thriller.

Pacific Grove, Carmel and Solvang – Our first road trip of 2024

I started writing this post from one of the most charming hotels I have stayed at! A majority of this post will be about the wonder that is Green Gables Inn on Ocean View Blvd. in Pacific Grove. Other parts will be about how we started the new year with some amazing views, great food and happy, hopeful hearts.

The drive from Paso Robles to Monterey (near Pacific Grove) was just under two hours. Once again, the route was scenic with puffy white clouds swimming across the vast blue canvas. The weather stayed cool and with the sun out, we didn’t need any layers in the car for the drive over. As soon as we hit Ocean View Blvd, I knew we were in for a treat if the hotel was anywhere on it. Thanks to Summer’s previous stay at one of the Four Sisters properties, we had gotten an excellent deal on Green Gables Inn for this trip. When we actually got to place, I was simply ecstatic.

Green Gables Inn

The inn is a converted Victorian mansion built in 1888 with glasswork reminiscent of the era. It is the first of the Four Sisters properties to be converted into an inn back in the ’70s. As we walked into the lobby, I noticed 4 beautiful, simple chandeliers, each laced with a layer of shells. There is a fireplace, perhaps fed by a gas pipe, but it has the charm of a cabin-in-the-woods fireplace. The instrumental music added to the timeless vibe. Our check-in was easy and the hotel receptionist showed us around explaining the location of all amenities. And then came the icing on the cake. Our room – called the Chapel Room – had a direct view of the ocean before us. It was cozy, clean and the architecture sent us back to another era. The triangular high ceiling with wooden beams going across it made us feel like we were staying in a chapel indeed. Over the next three days, we spent a lot of time listening to the waves and taking in the magnificent view from our room, and from the inn lobby. It’s the kind of view I imagine all the fancy Gilded Age characters had from their Newport mansions.

View from Green Gables Inn lobby

We started our Pacific Grove vacation by taking a walk to Lighthouse Avenue, one of the cool streets of the area. Here we had lunch at Victorian Corner while taking in the laid-back ambiance of the neighborhood. We then made our way back to Ocean View Blvd where we took a stroll by the ocean. Around dusk, we ended up on Lighthouse Ave. again and Summer showed me the Gosby Inn, another one of the Four Sisters Inns where she had stayed during her last visit. Dinner was at the nearby Pacific Thai Cuisine and it consisted of some warm sake, Pad Thai and Tom Yum soup. Later, we drove around the street and spotted something called the Ice Cream Shoppe playing loud music. Naturally, we were intrigued – not enough to walk in but just enough to Google it. Turns out that it is a shop with a lot of ‘Beatles’ memorabilia and some decent ice cream.

We had breakfast at Green Gables the next morning as it was included in our package. I enjoyed the scrambled eggs, toast, maple syrup and some hot French Roast coffee, while Summer made the healthy choice of oats and fruit. This was followed by a shower in the private bathroom across the hallway (we were given a key) which was well-equipped with a fancy vanity section and cute shower room. We then took a 15-min drive to Carmel as recommended by our brother-in-law, Chris. That afternoon, we walked around some of the fancy streets flanked by humongous trees and trendy stores, had lunch in the patio of a lovely restaurant called Village Corner. It had a fire pit. Here, I tried something called the Mai Tai beer which tasted a lot like a regular IPA. Summer and I split a salad and a pizza while appreciating the European ambiance of this restaurant patio and the quiet streets around it.

Village Corner in Carmel

Walking around some more, we were excited to spot names of my sisters-in-law and mother-in-law on stores and plaques. We visited Pilgrim Books, something Summer had seen on Instagram, and had a chat with the nice owner. After this, we drove to Asilomar looking for Phoebe’s Cafe but it was closed – we did spot a deer crossing the street though. Later in the evening, it started raining but we kept our dinner reservation at Fandango, one of the fancier places in town, where we had a delicious pasta and dessert.

Lovers Point

The rest of our vacation was just spent relaxing, enjoying the marvelous space at the inn, and walking around Pacific Grove by the ocean. We walked to Lovers Point, where Summer saved me from the glare of some wild squirrels. We also took a 10-minute walk to Cannery Row – the more touristy part of this location. One of the highlights there was lunch at A Taste of Monterey. With huge, comfy sofa chairs placed right at the large glass window facing the bay, this restaurant had just the right ambiance for a leisurely vacation lunch. Our waitress, Elyse, was really sweet and also handed us some binoculars, that come attached with a picture sheet of marine life you can spot in the bay right from your seat. As we enjoyed our wine flight, salad and nachos, we were able to spot otters, dolphins, seagulls, pelicans, a row boat and a buoy. The otters were particularly cute, Summer thought. It was also quite magnificent to witness the changing colors of the sky as the weather changed from gloomy to gorgeous.

View from ‘A Taste of Monterey’

On our walk back, we visited Lighthouse Books where I picked up “The New Lifetime Reading Plan”. A quick trip to the Reusable Records store turned out to be quite fruitful as I got 4 records from talented artists for our new gramophone at home. I have been listening to these since my return and I can’t get over the beautiful voice of Joanie Sommers and one of my absolute favourites – Jim Croce.

We bid goodbye to the inn the next morning. I knew well that I will miss the natural sound of crashing waves, the extraordinary architecture of the Chapel Room, sights of jogging men and women, e-bikers, happy couples, but mostly – the water turning turquoise to deep blue to gray to pitch black with white waves during the course of the day. I was excited to get back home though, as I felt rejuventaed and ready for the New Year.

Gorgeous woman at Green Gables Inn

We stopped at Solvang for a day where walked around and hit our usual spots – Mortensen’s Bakery, the windmill, the Belgian Cafe for breakfast, and Olsen’s Bakery for some irrestible danishes. A new place we tried this time for dinner was Craft House at Hotel Corque. We quite liked the ambiance, cocktails and the food here. Summer was particularly impressed with the Gnocchi Alfredo.

Gnocchi Alfredo at Craft House in Solvang

The drive back to Los Angeles took around 2 hours 45 minutes on account of some traffic soon after we got out of Solvang. It was a plesant drive overall and a wonderful vacation that almost felt like our second honeymoon. I came back, as mentioned in the beginning, with joy in my heart and great energy and enthusiasm for the year to come.

Wishing anyone reading this a fantastic 2024!