Update agent examples and quickstart to support Lakebase Autoscaling by jennsun · Pull Request #151 · databricks/app-templates

jennsun · 2026-03-04T19:54:55Z

updated quickstart experience to select instance:

examples work

- Add autoscaling (project/branch) as an alternative to provisioned Lakebase instances across all 3 memory templates - Detect app environment via DATABRICKS_APP_NAME and use PGENDPOINT (auto-injected by platform) for autoscaling in deployed apps - Update quickstart to support creating new Lakebase instances or connecting to existing provisioned/autoscaling instances - Use autoscaling_endpoint parameter (renamed in databricks-ai-bridge) - Add databricks-ai-bridge git dependency for autoscaling support - Update tests to remove update_databricks_yml_lakebase references Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

jennsun · 2026-03-05T23:43:00Z

.scripts/source/test_quickstart.py

+      endpoint_type: ENDPOINT_TYPE_READ_WRITE
+      autoscaling_limit_min_cu: 0.5
+      autoscaling_limit_max_cu: 4
+


note: DABs -> app resources for autoscaling is not ready yet so testing gets:

Error: Exit code 1 Warning: unknown field: postgres at resources.apps.agent_langgraph_long_term_memory.resources[1] in databricks.yml:42:11 Uploading bundle files to /Workspace/Users/jenny.sun@databricks.com/.bundle/agent_langgraph_long_term_memory/dev/files... Error: exit status 1 Error: Invalid Attribute Combination

in the meantime we will test by adding it as a resource to apps manually and deploying dab without this resource

jennsun · 2026-03-05T23:56:35Z

agent-langgraph-long-term-memory/pyproject.toml

+    # Note: Using git reference until official release
+    "databricks-langchain[memory] @ git+https://github.com/databricks/databricks-ai-bridge@lakebase-autoscaling-support#subdirectory=integrations/langchain",
+    "databricks-ai-bridge @ git+https://github.com/databricks/databricks-ai-bridge@lakebase-autoscaling-support",
    "databricks-agents>=1.9.3",


will remove after release

dhruv0811

Looks good overall!! Left some comments for local testing cleanup and some clarifications on lakebase options.

dhruv0811 · 2026-03-05T23:45:18Z

.gitignore

 !.claude/AGENTS.md
-!.claude/CLAUDE.md
+!.claude/CLAUDE.md
+/agent-langgraph-long-term-memory/e2e-chatbot-app-next


I dont think the chatbot UI template should be here? users might want to edit it themselves in the future.

accidentally added this during my own testing, let me revert

dhruv0811 · 2026-03-05T23:46:12Z

agent-openai-agents-sdk-short-term-memory/databricks.yml

-          database:
-            instance_name: '<your-lakebase-instance-name>'
-            database_name: 'databricks_postgres'
+        - name: 'postgres'


nit: couple comments around here saying this is for autoscaling, see below for provisioned?

dhruv0811 · 2026-03-05T23:47:47Z

agent-openai-agents-sdk-short-term-memory/.env.example

+# TODO: Update with your Lakebase instance for session storage
+# Option 1: Provisioned instance (set instance name)
+# LAKEBASE_INSTANCE_NAME=
+# Option 2: Autoscaling instance (set project and branch)


Did we not have a third option with just autoscaling_endpoint?

the thinking here is that when users develop locally, they do so via passing in project/branch name. the autoscaling_endpoint is only used when we are in the app environment and we can directly read from PGENDPOINT (since it's not as user friendly to pass in) - hence adding this check: https://github.com/databricks/app-templates/pull/151/changes#diff-1e8ffff9ea9c91fc9dce7d8af129175d1fcfe357eabbcec14705feff13eeacacR53

agent-langgraph-short-term-memory/databricks.yml

dhruv0811 · 2026-03-05T23:50:54Z

agent-langgraph-short-term-memory/.gitignore

+!.claude/skills/migrate-from-model-serving/
+
+# Exclude e2e chatbot app (separate project)
+e2e-chatbot-app-next/


The user might want to modify the chatbot UI on their own in the future after cloning a template. We shouldn't be including this in the gitignore.

dhruv0811 · 2026-03-05T23:51:58Z

agent-langgraph-short-term-memory/agent_server/start_server.py

 # Define the app as a module level variable to enable multiple workers
 app = agent_server.app  # noqa: F841
-setup_mlflow_git_based_version_tracking()
+try:


Nit: why are we catching a broad exception for this? In which cases does this mlflow setup not work easily?

dhruv0811 · 2026-03-05T23:53:36Z

agent-langgraph-short-term-memory/agent_server/agent.py

        # Check for Lakebase access/connection errors
        if any(keyword in error_msg for keyword in ["permission"]):
            logger.error(f"Lakebase access error: {e}")
+            lakebase_desc = LAKEBASE_INSTANCE_NAME or LAKEBASE_AUTOSCALING_ENDPOINT or f"{LAKEBASE_AUTOSCALING_PROJECT}/{LAKEBASE_AUTOSCALING_BRANCH}"


Is it worth doing some validation like we did in the SDK to ensure that we only have one valid combination of variables set here? Say a user has project and branch set, but accidentally also set instance name, they should be notified rather than silently picking up instance name and short circuiting here.

dhruv0811 · 2026-03-05T23:54:38Z

agent-langgraph-long-term-memory/databricks.yml

Same here, not sure if we want these changes to be persisted to app templates? They look like local testing changes.

jennsun mentioned this pull request Mar 4, 2026

Update agent examples to support Lakebase Autoscaling #147

Closed

jennsun changed the title ~~Update agent examples to support Lakebase Autoscaling~~ Update agent examples and quickstart to support Lakebase Autoscaling Mar 4, 2026

jennsun marked this pull request as ready for review March 4, 2026 21:44

jennsun force-pushed the lakebase-autoscaling-updates-v2 branch from 248b026 to e39267c Compare March 5, 2026 23:21

rm dab postgres resource since not ready in apps yet

0722c13

jennsun commented Mar 5, 2026

View reviewed changes

restore to template scaffolding code

e02ef37

jennsun commented Mar 5, 2026

View reviewed changes

dhruv0811 reviewed Mar 5, 2026

View reviewed changes

jennsun added 5 commits March 5, 2026 15:58

revert gitignore fixes

1e3fd13

.

4793304

revert dab blocks

e8868ab

.

6530c00

revert quickstart test

743d7e2

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update agent examples and quickstart to support Lakebase Autoscaling#151

Update agent examples and quickstart to support Lakebase Autoscaling#151
jennsun wants to merge 8 commits intodatabricks:mainfrom
jennsun:lakebase-autoscaling-updates-v2

jennsun commented Mar 4, 2026 •

edited

Loading

Uh oh!

jennsun Mar 5, 2026 •

edited

Loading

Uh oh!

jennsun Mar 5, 2026

Uh oh!

dhruv0811 left a comment

Uh oh!

dhruv0811 Mar 5, 2026

Uh oh!

jennsun Mar 6, 2026

Uh oh!

dhruv0811 Mar 5, 2026

Uh oh!

dhruv0811 Mar 5, 2026

Uh oh!

jennsun Mar 6, 2026

Uh oh!

Uh oh!

dhruv0811 Mar 5, 2026

Uh oh!

dhruv0811 Mar 5, 2026

Uh oh!

dhruv0811 Mar 5, 2026

Uh oh!

dhruv0811 Mar 5, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

jennsun commented Mar 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jennsun Mar 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

dhruv0811 left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

jennsun commented Mar 4, 2026 •

edited

Loading

jennsun Mar 5, 2026 •

edited

Loading