AI Pilots Don’t Scale by Accident: Takeaways from Databricks Data + AI Summit 2026

What four days at the Databricks Data + AI Summit taught me about making agentic analytics actually work

I spent this week at DAIS 2026 in San Francisco — four days of sprinting between buildings, conference rooms, and keynote halls to catch as many sessions as possible. I tried my best to get a full picture, not just the headline announcements.

Sessions included Intelligent Document Parsing with Lakeflow, AI Mesh: The Age of AI Products, Your AI Strategy is Only as Good as Your People Strategy, How J&J Medtech and Takeda Scale Data & AI, An Intro to Building & Scaling Agentic Apps, Agentic Analytics on the Databricks Lakehouse, and Latest Innovations in AI/BI for Business Users.

The energy was electric. The keynote session was attended by over 30,000 professionals – I had never been in a room like that before. The demos were impressive. And one slide — almost easy to miss in the middle of a packed breakout session — said something that has stayed with me:

“Most organizations don’t have an AI innovation problem. They have a reuse, governance, and trust problem.”

This diagnosis lands with particular weight in regulated, data-intensive industries like life sciences.

The Pattern We Keep Seeing

Across industries, a common AI adoption story plays out like this: a team identifies a high-value analytics problem, builds something smart to solve it, and sees real results. Then another team does the same — independently, for their own version of essentially the same question. Then another.

Each effort is genuinely useful. Each one also operates in isolation: its own data assumptions, its own logic, its own definition of the metrics that matter. There’s no shared semantic layer — no governed, agreed-upon source of truth that all these efforts draw from. No common framework for what “on track” means, or how performance is measured, or which numbers are approved for which audiences.

The result isn’t a lack of AI capability. It’s a proliferation of disconnected outputs that are difficult to reconcile, expensive to maintain, and nearly impossible to scale across a large user base.

The next use case starts from zero. Again.

This is the AI pilot trap. And based on the sessions I attended – looks like it’s everywhere.

What “Agentic Analytics” Actually Requires

The most useful framing I took away from DAIS came from the session on Agentic Analytics on the Databricks Lakehouse. The presenters used the example of a data analyst “Jess” and laid out three failure modes with uncomfortable clarity:

Accuracy — Agents lack the semantic grounding to write accurate queries. Ask an agent “what’s our dropout rate in the APAC region this quarter?” and it will give you an answer. Whether that answer matches your function-specific definition of dropout, your certified enrollment table, or your SME-approved denominator — that’s a different question entirely.

Governance — What data and tools are the agents allowed to access? Who approved this agent’s access to a certain table? Can it write to operational dashboards? Does it behave differently depending on who’s asking? Agents access data and tools in ways that weren’t designed for them.

Scale — Agents that work in a pilot cause performance and cost problems at enterprise scale. Lightning-speed query response times and predictable infrastructure costs aren’t luxuries when you’re running analytics across hundreds of trials for thousands of users.

These are the exact failure modes that could turn a promising clinical ops AI initiative into a governance escalation.

The Architecture That Changes the Equation

What Databricks laid out — and what I think is genuinely the right pattern for enterprise analytics teams — is a four-layer answer to these three problems:

Compute (Lakehouse RT) — gives you the scalable, cost-efficient foundation. Sub-second responses across large clinical datasets without unpredictable cloud bills.

Governance (Unity AI Gateway) — acts as a single control plane: agent registry, access control, contextual policies, cost budgets, and tracing. One place to govern both data and AI. One place to ask “who approved this?” and get an actual answer.

Semantics (Genie Ontology) — THIS, for me, what the most valuable aspect of the entire conference. It is the piece that made every room lean forward. Rather than each team maintaining their own definitions, you build a shared business ontology — enrollment milestone timelines, regional performance benchmarks, patient dropout criteria — once, in a governed layer, and every agent draws from it. This can be defined based on functional definitions. An agent querying trial performance doesn’t decide what “on track” means. The ontology does.

Agent Choice — deploy through Genie One, custom agents, or MCP endpoints, wherever your users actually work: in MS Teams, in your clinical ops portal, in a mobile dashboard during a site visit.

The phrase from the keynote that stuck: one platform, one identity model, one governance plane.

The Harder Question: Who Owns This?

The most practically useful session I attended was on “AI Products” — not AI features, not AI pilots, but AI products. The framing was simple: the domain owner defines the reusable business capability before the team implements the agent.

In clinical trial operations, that means someone has to own the answer to: what is our certified definition of enrollment rate? What’s the governed source of site dropout data? Which metrics are approved for executive reporting versus investigational use?

That’s not an engineering question. It’s a data leadership question. And the organizations that answer it first — that build once, govern once, and compose many times across their agent ecosystem — are the ones that will turn AI pilots into AI infrastructure.

The ones that don’t will keep rebuilding the same agent, for the same question, on the same data, six months from now.

Dilip Merala is a Data & AI Analytics Manager specializing in clinical trial operational analytics. He attended the Databricks Data + AI Summit 2026 in San Francisco.

Radio Show – March 2025

I’m all set to appear in another radio show produced by Mary Main Productions. Once again, I am fortunate to voice various characters in 4 stories but especially – detective Nick Charles, solving and preventing crimes with his wife Nora Charles (played by my better half, Summer). This interesting format where actors appear on stage as characters from 1930s radio artists and read from a script has been quite new and revelatory for me. Here’s some marketing material.

Paso Robles – Our last road trip of 2023

I have always enjoyed traveling during wintertime. Most of my happy solo backpacking trips back in India happened during winter. So did my long motorcycle trips with my partner in crime, Nikhil aka frozencolor. Many a time on such trips as a bachelor, I used to imagine a future when I will be embarking on such vacations with my soul mate. Now that I have found her, it’s an exciting time in my life as I get to explore some wonderful destinations with her. For our last trip of 2023, we chose to do a road trip and stay within California in the interest of time and convenience. Also, I have come to learn that this state is a country in itself with everything you might look for in a vacation spot, readily available someplace nearby. And the weather is almost always just… heartwarming! We planned a week-long cusp vacation to bid goodbye to 2023 and welcome 2024. Our pick to ring in the new year was someplace pretty, quiet and peaceful – not a dead town with nobody around but not a bustling city with ostentatious bells and whistles on New Years Eve either. There were quite a few worthy contenders but the winner this time was Paso Robles.

Indian man posing at a winery

Having been to Paso a couple of times already, we knew what we were in for. The drive was spectacular with California 46 bringing the drama. Magnificent skies and open roads flanked by hillocks, rainbows, meadows graced us all the way till Paso Robles. We arrived in time for our check in at The Adelaide Inn where the lobby was spruced up for the holidays with a festive Christmas theme. Our receptionist guessed that we were an Indo-American couple from, well, our looks. She mentioned that she would love to attend an Indian wedding someday as there is always some drama and an angry “aunty”. I joked that there was nobody angry at our wedding (that we knew of). We then proceeded to our room that was simple, clean, spacious and provided all the comforts we could ask for. The television cabinet was pretty neat with sliding doors to conceal what’s inside i.e. the TV. I got excited about the Starbucks across the street and got a coffee as soon as we settled in. The weather stayed around 50-60 degree F (10 to 16 degree C) making us feel the cozy, holiday charm of winter.

California 46 to Paso Robles

We were quite well-prepared for this 2-night stay at Paso Robles, having made reservations for most major meals. Our first dinner was at Taste Craft Eatery – a wonderful slider and cocktail place in the heart of downtown Paso Robles. We got there ahead of time so we walked around the streets, as we usually like to do. We entered a general store called “General store” with a cool collection of items. Here, I indulged in my last impulse buy of 2023. You see, I have been growing a bit of a paunch, giving me a cute but undesirable ‘skinny everywhere else but big and round in the middle’ kind of shape. My goal for next year is to make my body a bit more symmetric and desirable to people who don’t love me already. So when I saw a book titled “Salads”, I knew I had to buy it so that I can incorporate it in my meals for all of 2024.

Hometown House salad at Taste Craft Eatery in Paso Robles

Two young ladies greeted us outside Taste and one of them escorted us to our table deep inside the space. Our drinks and food at Taste were quite delicious. I am usually a beer guy and Summer, though not a big drinker, likes whiskey better than beer. This time, we switched preferences with me getting a whiskey sour and Sumer going for a blood orange beer. The Hometown house salad was very satisfying and our variety of siders (two “Duo”s) did the trick for a nice, satisfying dinner. The next morning, we simply walked to the nearby Margie’s Diner and had a lovely breakfast sticking to our usual choices – Denver omelette with potatoes for me and oats with fruits for her.

That afternoon, we had a reservation at Calcareous Winery – one with some fond memories for us. On our last trip to Cambria when we got engaged, we had driven down to this winery to make the calls and inform our loved ones about my moment of courage when I went down on my knee, and Summer’s moment of weakness when she said “Yes”. This time, we were visiting this beautiful winery as a married couple. We took in the gorgeous view, enjoyed their tasting with an impressive list of wines (one white, three red and a bonus), and split a lip-smacking burger that was brought in looking like Julius Caesar.

Burger and chips at Calcareous Winery in Pas Robles

After the short drive back to town, we visited the cute Spearhead Coffee Shop for a little sip-and-chat. We then made it for our reservation at Buena Tavola for some cocktails, salad, and pasta. My experiment with Negroni for a cocktail did not go down well with my taste buds (lesson learned!). The ambiance at this restaurant was akin to what I had watched in the movies. It was a cozy Italian place with tables near enough to each other that it felt like one big community dinner. We could easily overhear conversations but we tuned into our own in a few minutes. I tried my best not to stare too long at other people’s food. We finished the meal with a memorable chocolate soufflé which was plated like a champ.

Soufflé Al Cioccolato at Buena Tavola

Our next plan of action was to take a sneak peek at the big event that was the talk of the town – the bonfire. Wherever we went, everyone we interacted with asked us if we were going to the bonfire. Naturally, we were intrigued. Thankfully, the downtown park where this event was happening was just a block away from Buena Tavola so we found a convenient parking spot nearby for the whole evening. As we started walking towards the park after dinner, we could already sense the hustle-bustle from a distance. The whole town seemed to have assembled at the downtown park for this bonfire surrounded by well-lit, decked up trees and happy party-goers grooving to a LIVE band. And here I witnessed the irony of life, as I saw three firemen throwing huge logs in a bonfire to keep the flames going up.

We walked around the bonfire, clicked some pictures, exchanged some smiles with strangers, danced to the music for a bit, and decided to call it a night to head back to our champagne and chips at the inn. The remainder of the night was spent watching the saucy Sigourney Weaver, sipping champagne, and finally wishing each other a Happy New Year at midnight – our first one as Mr. and Mrs. 😀

The next morning, on New Year’s Day, we took off on our first road trip of 2024. More on that in my next post.

Monster Mash – My California Stage Debut

After striking out on putting up my own production on stage in December 2021 due to the onset of the Omicron variant, I was deligted to be invited to play Dracula in MeMain Productions’ Monster Mash. Teaming up with an impressive, fun, enthusiastic group of artists (including my better half), I had a wonderful time rehearsing for this goofy show which went from scary to funny to emotional with no warning. And then, the shows themselves turned out to be a happy experience for me as an actor, and an exhilirating roller coaster for the audience.

Dracula and Medusa

I was ecstatic to be performing for a LIVE audience after four years. The last time I was in front of a LIVE theatre audience was The Rocky Horror Show in Dallas where I also got a chance to a do a little pre-show stand-up act. Then, I graduated, the pandemic hit, I moved to Los Angeles, and got busy with my day job as a Biotech Data Analytics Manager.

The monsters

Thankfully, I had kept myself active with other gigs like stand-up acts, workshops, and lessons. It came in handy when I stepped back into my stage shoes for this extremely well-written show. The audiences were generous, some of them friends and family, others happy strangers who were sweet enough to stop by afterwards and pay a compliment. All in all, I would say we did quite a memorable MASH!

Coming Soon – A Halloween Special!

I am excited to share that I will be back on stage soon. Rehearsals are in full swing and this cast is a delight to work with. Stoked to see how this turns out! Also, it’s my first time professionally acting with someone special 😉

Monster Mash at The Main – October 2023

The bring-take and come-go conundrum

I “take” Summer to my friend’s party but she “brings” me to her parents’ house. When I’m going to an event, I ask her if she wants to “come” but when she is going to an event, she asks me if I want to “go”. When deciding what she will do for lunch at work, she says she will “bring” the salad that’s in the fridge. I would have said I’ll “take” the salad. What is this conundrum?!?

When she took/brought me to Santa Monica Pier

My logic is – anything that’s coming where I am is being “brought” to me and anything that’s going away is being “taken”. So since the salad is going from my fridge to the office, I am “taking” it and not “bringing” it. Similarly, if I am going somewhere, then anyone accompanying me is “coming” with me while I myself am “going” there. No?

Potato song – My vegetable series

I have been meaning to do this for a while – a simple vegetable song series to get kids to eat their veggies. Starting with the one that’s a great source of vitamin C and potassium!

Dilip Merala’s Potato song

Playing Guide and Tourist in Hollywood

After fighting the Mumbai Vs Delhi battle for years in Dallas, Nivesh and I had a new one to fight now – New York vs Los Angeles. He moved for work to New York and I to LA. So it was natural that we keep the tradition going. I visited NY last year and he finally decided to visit me in LA this week. While continuing the banter, he was able to take in some pretty things this city has to offer.

Summer started him off with a welcome walk in the Studio City neighborhood. We then ate at HOPE, a wonderful vegan place that has become one of my favorites in the area. I thought he would like that since it’s often difficult for vegetarians to find good food (as we had experienced on our New Orleans trip). We then did another short walk around Laurel Tavern in the evening (of course we had to! There’s a whole new post coming about this pub that’s like my second home). And that was his quiet first day in LA.

Our second day was dedicated to Santa Monica Pier. Summer drove us through Sunset Boulevard all the way to the ocean and then to Santa Monica. We are at the famous Bubba Gump Shrimp Co and walked on the pier. Then, we took a scenic canyon drive back home and kept it quiet and simple in the evening with some leftover food for dinner.

Finally, on his last day in LA, we decided to take the cliche Hollywood bus tour. That’s something I hadn’t done yet myself so this was a good opportunity out for me to play tourist too. Nivesh and I hopped on the bus at 1 pm from Sunset Blvd and the next two hours were dedicated to checking out some lovely houses, spectacular hilly views including the iconic Hollywood sign, and popular restaurants, clubs and hotels that are frequented by celebrities. Seeing all the fancy Mullholland and Beverly Hills houses was a special treat. We had no idea that our very own Shah Rukh Khan had purchased a house on Mullholland but sold it just 5 weeks ago.

After the bus tour, we hopped off the bus and walked around the popular Hollywood and Highland area. We spotted many stars on the Walk of Fame, checked out some cool and famous footprints at TCL Chinese Theatre, walked to the Dolby theatre and other Hollywood hotspots, and finally ate lunch at California Pizza Kitchen (makes sense for a New Yorker, no?) before heading home.

New York based Indian in LA’s TCL Chinese Theatre

Later that evening, we saw our friends Jeremy and Tushar at The Village. Nivesh called it a night after that as he had an early flight. And I went back to Laurel Tavern with my friends for some Saturday night drinks. It was fun to play both guide and tourist over a weekend to a dear friend, who might now have become a convert and lean towards saying – LA rocks!

Getting back into the work rhythm

And just like that, it’s two weeks into January and work has picked up. Morning meetings at 7:30 am, fires to put out, exciting new projects, nerves about the upcoming reviews and appraisal season… just everyday corporate things.

When I took a couple of years off from corporate life to explore (travel, acting, that kind of thing), it was this routine that I started missing the most. Even more than the monthly paycheck, it was the assurance of knowing what I was going to do the next morning. Having someplace to go, some target to hit, some people to meet. It often gets monotonous real quick but with the right job, the right people and the right incentive – like it is in my present case – it can be a breath of fresh air. Something you look forward to. Something that helps you grow, explore other exciting things, explore your own boundaries.

With this new year, as I get back into the so-called grind, my heart is filled with hope, excitement and a sense of adventure. Upward and onward…