本文へ移動
cccskills
無料GitHub で公開

azure-databricks

Expert knowledge for Azure Databricks development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when working with Unity Catalog, Lakehouse/Lakeflow, Lakebase, AI Runtime/model serving, or external connectors, and other Azure Databricks related development tasks. Not for Azure Synapse Analytics (use azure-synapse-analytics), Azure HDInsight (use azure-hdinsight), Azure Machine Learning (use azure-machine-learning), Azure Data Factory (use azure-data-factory).

インストール方法を見る

含まれるファイル(8)

  • SKILL.md55.9 KB
  • architecture-patterns.md10.9 KB
  • configuration.md137.3 KB
  • decision-making.md20.7 KB
  • deployment.md12.8 KB
  • integrations.md236.4 KB
  • limits-quotas.md19.7 KB
  • security.md68.4 KB

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

Azure Databricks Skill

This skill provides expert guidance for Azure Databricks. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

  • Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
  • Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

CategoryLocationDescription
TroubleshootingL37-L183Diagnosing and fixing Databricks issues: Spark and SQL errors, connectors and Lakeflow pipelines, model serving and AI Runtime, CLI/IDE/Git problems, and monitoring/debugging tools.
Best PracticesL184-L398End-to-end Databricks best practices for cost, governance, security, performance, streaming, AI/ML/RAG, connectors, and Lakehouse design, plus tuning, testing, and operating production workloads.
Decision Makingdecision-making.mdGuides for architectural and cost decisions in Azure Databricks: choosing compute, runtimes, AI/BI tools, connectors, and migration paths for workspaces, pipelines, models, and Unity Catalog.
Architecture & Design Patternsarchitecture-patterns.mdArchitectural blueprints and patterns for Databricks: DR/HA, networking, storage, Lakehouse/medallion, Lakeflow/CDC, Lakebase, multi-agent/AI pipelines, MLOps, feature stores, and streaming.
Limits & Quotaslimits-quotas.mdLimits, quotas, and constraints for Databricks compute, AI/model serving, Lakeflow pipelines, connectors, Unity Catalog, Free Edition, and related resource usage and throttling behavior.
Securitysecurity.mdIdentity, access control, encryption, networking, compliance, and secret management for Azure Databricks, Unity Catalog, AI/Apps, Lakeflow, Lakebase, and external data/model connections.
Configurationconfiguration.mdConfiguring and governing Azure Databricks: accounts, workspaces, compute, networking, storage, AI/ML, Lakeflow, Unity Catalog, SQL, connectors, CLI, and monitoring/cost/observability settings.
Integrations & Coding Patternsintegrations.mdPatterns and examples for integrating Databricks with apps, agents, AI/ML, external databases/BI tools, Lakehouse Federation, Lakeflow, AI Runtime, and SQL/PySpark APIs and UDFs.
Deploymentdeployment.mdDeploying and managing Azure Databricks workspaces, apps, models, pipelines, and Lakebase using ARM/Bicep/Terraform/Bundles/CI-CD, plus Unity Catalog, AI Runtime, and model serving deployment patterns.

Troubleshooting

TopicURL
Use Databricks identity management readiness reporthttps://learn.microsoft.com/en-us/azure/databricks/admin/users-groups/automatic-identity-management/readiness-report
Debug custom code agents on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/agents/custom-agents/debug-agent
Detect and clean up unused AI Search endpointshttps://learn.microsoft.com/en-us/azure/databricks/ai-search/unused-endpoints
Troubleshoot Azure Databricks Artifact Registry issueshttps://learn.microsoft.com/en-us/azure/databricks/artifact-registry/troubleshooting
Resolve Databricks classic compute termination error codeshttps://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/cluster-error-codes
Debug Spark applications using Databricks Spark UIhttps://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/debugging-spark-ui
Monitor Databricks dashboard usage with audit logshttps://learn.microsoft.com/en-us/azure/databricks/dashboards/monitor-usage
Troubleshoot common Databricks CLI issueshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/troubleshooting
Use Databricks app details for monitoring and troubleshootinghttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/view-app-details
Troubleshoot Databricks Connect for Python issueshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/troubleshooting
Troubleshoot Databricks Connect for Scala issueshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/troubleshooting
Troubleshoot Databricks Terraform provider issueshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/troubleshoot
Troubleshoot issues with the Databricks IDE extensionhttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/troubleshooting
Handle ARITHMETIC_OVERFLOW errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/arithmetic-overflow-error-class
Resolve CAST_INVALID_INPUT errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/cast-invalid-input-error-class
Diagnose DC_GA4_RAW_DATA_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-ga4-raw-data-error-error-class
Understand DC_SFDC_API_ERROR in Databricks connectorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sfdc-api-error-error-class
Diagnose DC_SQLSERVER_ERROR in Databricks connectorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sqlserver-error-error-class
Handle DELTA_ICEBERG_COMPAT_V1_VIOLATION errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/delta-iceberg-compat-v1-violation-error-class
Resolve DIVIDE_BY_ZERO error in Azure Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/divide-by-zero-error-class
Handle Azure Databricks error condition stringshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/error-classes
Troubleshoot EWKB_PARSE_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/ewkb-parse-error-error-class
Troubleshoot EWKT_PARSE_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/ewkt-parse-error-error-class
Troubleshoot GEOJSON_PARSE_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/geojson-parse-error-error-class
Resolve GROUP_BY_AGGREGATE errors in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/group-by-aggregate-error-class
Handle H3_INVALID_CELL_ID errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-cell-id-error-class
Fix H3_INVALID_GRID_DISTANCE_VALUE errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-grid-distance-value-error-class
Fix H3_INVALID_RESOLUTION_VALUE errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-resolution-value-error-class
Resolve H3_NOT_ENABLED errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-not-enabled-error-class
Handle INSUFFICIENT_TABLE_PROPERTY errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/insufficient-table-property-error-class
Resolve INVALID_ARRAY_INDEX errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-error-class
Resolve INVALID_ARRAY_INDEX_IN_ELEMENT_AT errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-in-element-at-error-class
Fix MISSING_AGGREGATION errors in GROUP BYhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/missing-aggregation-error-class
Troubleshoot ROW_COLUMN_ACCESS errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/row-column-access-error-class
Interpret Azure Databricks SQLSTATE error codeshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/sqlstates
Resolve TABLE_OR_VIEW_NOT_FOUND errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/table-or-view-not-found-error-class
Fix UNRESOLVED_ROUTINE errors in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/unresolved-routine-error-class
Handle UNSUPPORTED_TABLE_OPERATION errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-table-operation-error-class
Handle UNSUPPORTED_VIEW_OPERATION errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-view-operation-error-class
Troubleshoot WKB_PARSE_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/wkb-parse-error-error-class
Troubleshoot WKT_PARSE_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/wkt-parse-error-error-class
Troubleshoot common Genie Agent query issueshttps://learn.microsoft.com/en-us/azure/databricks/genie-agents/troubleshooting
Auto Loader FAQ and operational guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/faq
Monitor and troubleshoot Auto Loader pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/observability
Troubleshoot 1Password Event Logs connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/1password-event-logs-troubleshoot
Troubleshoot Aha! managed connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/aha-troubleshoot
Troubleshoot Akamai WAF connector authentication and errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/akamai-waf-troubleshoot
Troubleshoot Databricks Amplitude connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/amplitude-troubleshoot
Troubleshoot Databricks Anaplan connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/anaplan-troubleshoot
Troubleshoot Anthropic connector ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/anthropic-troubleshoot
Troubleshoot Anysphere Audit Logs connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/anysphere-audit-logs-troubleshoot
Troubleshoot Anysphere Organization connector problemshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/anysphere-organization-troubleshoot
Troubleshoot Atlassian audit logs connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/atlassian-audit-logs-troubleshoot
Troubleshoot Databricks Celigo managed connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/celigo-troubleshoot
Troubleshoot Databricks Confluence ingestion errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-troubleshoot
Troubleshoot CrowdStrike Falcon Event Stream connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/crowdstrike-falcon-event-stream-troubleshoot
Troubleshoot Dynamics 365 ingestion via Synapse Linkhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/d365-troubleshoot
Troubleshoot Glean connector errors in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/glean-troubleshoot
Troubleshoot Gmail connector ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/gmail-troubleshoot
Troubleshoot Databricks Google Ads connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-ads-troubleshoot
Troubleshoot GA4 Raw Data connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-analytics-troubleshoot
Google Drive connector FAQs and behaviorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-drive-faq
Troubleshoot Google Drive ingestion in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-drive-troubleshoot
Troubleshoot Databricks Google Search Console connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-search-console-troubleshoot
Troubleshoot Databricks Google Workspace connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-workspace-troubleshoot
Troubleshoot HubSpot connector ingestion problemshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/hubspot-troubleshoot
Troubleshoot Jira ingestion issues in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/jira-troubleshoot
Troubleshoot managed Kafka connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/kafka-troubleshoot
Troubleshoot LinkedIn Ads connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/linkedin-ads-troubleshoot
Troubleshoot Marketo connector pipeline errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/marketo-troubleshoot
Diagnose and fix Meta Ads Lakeflow Connect ingestion errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/meta-ads-troubleshoot
Troubleshoot Microsoft 365 audit connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/microsoft-365-troubleshoot
Troubleshoot Monday.com Lakeflow connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/monday-com-troubleshoot
Troubleshoot Databricks MySQL ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-troubleshoot
Troubleshoot Netskope Logs Lakeflow connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/netskope-logs-troubleshoot
Troubleshoot Notion connector authentication and sync issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/notion-troubleshoot
Troubleshoot Databricks Okta System Logs connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/okta-system-logs-troubleshoot
Troubleshoot Databricks OpenAI connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/openai-troubleshoot
Troubleshoot Oracle integrated CDC ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/oracle-troubleshoot
Troubleshoot Outlook connector ingestion errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/outlook-troubleshoot
Troubleshoot Databricks PagerDuty connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pagerduty-troubleshoot
Troubleshoot Databricks Pendo connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pendo-troubleshoot
Troubleshoot Databricks PostgreSQL ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-troubleshoot
Troubleshoot Databricks query-based connectorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/query-based-troubleshoot
Troubleshoot managed RabbitMQ connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/rabbitmq-troubleshoot
FAQ for Databricks Reddit Ads ingestion connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/reddit-ads-faq
Troubleshoot Databricks Reddit Ads connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/reddit-ads-troubleshoot
FAQ for Databricks Salesforce ingestion connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-faq
Troubleshoot Databricks Salesforce ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-troubleshoot
Troubleshoot Databricks SendGrid connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sendgrid-troubleshoot
Troubleshoot Databricks ServiceNow ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/servicenow-troubleshoot
Troubleshoot Salesforce Marketing Cloud connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sfmc-troubleshoot
Troubleshoot Databricks SharePoint ingestion errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-troubleshoot
Troubleshoot Databricks Shopify connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/shopify-troubleshoot
Troubleshoot Databricks Smartsheet connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/smartsheet-troubleshoot
Troubleshoot Databricks SQL Server ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-troubleshoot
Troubleshoot Databricks Square connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/square-troubleshoot
Troubleshoot Databricks Strac connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/strac-troubleshoot
Troubleshoot TikTok Ads connector ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/tiktok-ads-troubleshoot
Diagnose and fix Databricks Lakeflow Connect ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/troubleshoot
Resolve UNITY_CATALOG_INITIALIZATION_FAILED in pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/uc-initialization-troubleshoot
Troubleshoot Veeva Vault connector errors in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/veeva-vault-troubleshoot
Troubleshoot Databricks Verkada connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/verkada-troubleshoot
Troubleshoot Wiz Audit Logs connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/wiz-audit-logs-troubleshoot
Troubleshoot Workday Activity Logging connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-activity-logging-troubleshoot
Troubleshoot Workday HCM connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-hcm-troubleshoot
Troubleshoot Databricks Workday ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-reports-troubleshoot
Troubleshoot common Workiva connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workiva-troubleshoot
Troubleshoot Zendesk Support connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zendesk-support-troubleshoot
Troubleshoot Databricks Zip connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zip-troubleshoot
Troubleshoot Databricks Zoho Books connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zoho-books-troubleshoot
Handle Zerobus Ingest error codes and failureshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-errors
Understand and use Azure Databricks init script logginghttps://learn.microsoft.com/en-us/azure/databricks/init-scripts/logs
Troubleshoot and repair Lakeflow Jobs failureshttps://learn.microsoft.com/en-us/azure/databricks/jobs/repair-job-failures
Monitor and troubleshoot materialized view refresheshttps://learn.microsoft.com/en-us/azure/databricks/ldp/dbsql/materialized-monitor
Resolve high initialization times in pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/fix-high-init
Recover Lakeflow pipelines from checkpoint failureshttps://learn.microsoft.com/en-us/azure/databricks/ldp/recover-streaming
Use Genie Code to debug AI Runtime GPUshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/genie-code
Use AI Runtime guides for usage tracking and troubleshootinghttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/guides/
Inspect and debug Databricks Feature Views in Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/explore-feature-views
Troubleshoot Databricks Feature Store and limitshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-and-limitations
Diagnose and fix Databricks model serving issueshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-debug
Use Genie Code to diagnose Databricks model servinghttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-genie-code
Debug Python code in Databricks notebookshttps://learn.microsoft.com/en-us/azure/databricks/notebooks/debugger
Troubleshoot common OpenSharing data access errorshttps://learn.microsoft.com/en-us/azure/databricks/opensharing/troubleshooting
Diagnose failing Spark jobs and removed executorshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/failing-spark-jobs
Use the Databricks jobs timeline to debug Sparkhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/jobs-timeline
Diagnose long Spark jobs using Databricks UIhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage
Investigate high I/O Spark stages in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-io
Debug skew and spill in long Spark stageshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-page
Debug slow Spark stages with low I/O in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/slow-spark-stage-low-io
Identify expensive reads in Spark DAG on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-dag-expensive-read
Diagnose gaps between Spark jobs in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-job-gaps
Diagnose and fix Spark memory issues on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-memory-issues
Troubleshoot Databricks Partner Connect issueshttps://learn.microsoft.com/en-us/azure/databricks/partner-connect/troubleshoot
Troubleshoot Databricks publishing and connections to Power BIhttps://learn.microsoft.com/en-us/azure/databricks/partners/bi/power-bi/troubleshooting
Troubleshoot Azure Databricks Git folder errorshttps://learn.microsoft.com/en-us/azure/databricks/repos/errors-troubleshooting
Handle Databricks SQL FETCH cursor errorshttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/fetch-stmt
Diagnose Databricks SQL OPEN cursor errorshttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/open-stmt
Detect and repair Delta table issues with FSCK REPAIR TABLEhttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-fsck
Handle INVALID_UTF8_STRING errors in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/validate_utf8
Use query history to troubleshoot Databricks SQL performancehttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-history
Interpret Databricks SQL query profiles for performance troubleshootinghttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-profile

Best Practices

TopicURL
Tag Azure Databricks resources for cost attributionhttps://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/usage-detail-tags
Use default Databricks compute policy familieshttps://learn.microsoft.com/en-us/azure/databricks/admin/clusters/policy-families
Implement managed disaster recovery for Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/admin/managed-disaster-recovery
Apply identity best practices in Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/admin/users-groups/best-practices
Apply best practices for serverless workspaceshttps://learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces-best-practices
Synthetically generate agent evaluation setshttps://learn.microsoft.com/en-us/azure/databricks/agents/agent-evaluation/synthesize-evaluation-set
Load test Databricks Apps agents for QPS limitshttps://learn.microsoft.com/en-us/azure/databricks/agents/custom-agents/load-test-agent-app
Measure RAG performance with retrieval and response metricshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/evaluate-assess-performance
Define RAG application quality with evaluation setshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/evaluate-define-quality
Evaluate and monitor RAG applications for quality, cost, latencyhttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/fundamentals-evaluation-monitoring-rag
Design and optimize RAG inference chains on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/fundamentals-inference-chain-rag
Build and tune unstructured RAG data pipelineshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-data-pipeline-rag
Improve RAG application quality via key tuning knobshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-overview
Optimize RAG chain components for better responseshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-rag-chain
Control coding agent costs with Unity Gateway budgets and routinghttps://learn.microsoft.com/en-us/azure/databricks/ai-gateway/coding-agent-costs
Monitor coding agent usage and traces in Unity Gatewayhttps://learn.microsoft.com/en-us/azure/databricks/ai-gateway/coding-agent-observability
Track foundation model spend by user and projecthttps://learn.microsoft.com/en-us/azure/databricks/ai-gateway/track-cost-tutorial
Apply performance best practices for AI Searchhttps://learn.microsoft.com/en-us/azure/databricks/ai-search/best-practices
Load test Databricks AI Search endpointshttps://learn.microsoft.com/en-us/azure/databricks/ai-search/endpoint-load-test
Improve Databricks AI Search retrieval qualityhttps://learn.microsoft.com/en-us/azure/databricks/ai-search/retrieval-quality
Migrate Databricks library installs from init scriptshttps://learn.microsoft.com/en-us/azure/databricks/archive/compute/libraries-init-scripts
Apply best practices for Databricks compute policieshttps://learn.microsoft.com/en-us/azure/databricks/archive/compute/policies-best-practices
Use DBIO for transactional writes to cloud storage in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/archive/legacy/dbio-commit
Optimize skewed joins in Databricks using skew hintshttps://learn.microsoft.com/en-us/azure/databricks/archive/legacy/skew-join
Migrate from Databricks Deep Learning Pipelineshttps://learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/deep-learning-pipelines
Apply Azure Databricks platform administration best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/administration
Optimize BI serving performance on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving
Prepare and model data for high-performance BI on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-data-prep
Optimize Azure Databricks SQL warehouses for BIhttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-sql-serving
Apply Azure Databricks compute creation best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/compute
Implement Azure Databricks production job scheduling best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/jobs
Apply Databricks-specific Power BI performance best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/power-bi
Use AI-generated comments for Unity Catalog documentationhttps://learn.microsoft.com/en-us/azure/databricks/comments/ai-comments
Apply best practices for Databricks classic computehttps://learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices
Use flexible node types for reliable Databricks computehttps://learn.microsoft.com/en-us/azure/databricks/compute/flexible-node-types
Apply best practices for Databricks poolshttps://learn.microsoft.com/en-us/azure/databricks/compute/pool-best-practices
Follow best practices for Databricks serverless computehttps://learn.microsoft.com/en-us/azure/databricks/compute/serverless/best-practices
Use Lakehouse Replay to validate runtime upgradeshttps://learn.microsoft.com/en-us/azure/databricks/compute/serverless/lakehouse-replay
Tune SQL warehouse settings for BI workloadshttps://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/bi-workload-settings
Control large interactive queries with Query Watchdoghttps://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/query-watchdog
Optimize Azure Databricks AI/BI dashboard cachinghttps://learn.microsoft.com/en-us/azure/databricks/dashboards/caching
Configure dataset materialization for Databricks dashboardshttps://learn.microsoft.com/en-us/azure/databricks/dashboards/materialization
Implement observability for Databricks streaming workloadshttps://learn.microsoft.com/en-us/azure/databricks/data-engineering/observability-best-practices
Handle schema evolution in Azure Databricks pipelineshttps://learn.microsoft.com/en-us/azure/databricks/data-engineering/schema-evolution
Apply best practices for Unity Catalog ABAC policieshttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/best-practices
Apply common ABAC row filtering and column masking patterns in Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/common-patterns
Optimize performance of ABAC row filters and column masks in Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/performance
Apply Unity Catalog governance best practiceshttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/best-practices
Manage Unity Catalog object storage lifecycle and recoveryhttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/object-storage-lifecycle
Author Unity Catalog service policies with exampleshttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/service-policies/policy-examples
Work with legacy Hive metastore objects in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/database-objects/hive-metastore
Safely use and migrate away from DBFS roothttps://learn.microsoft.com/en-us/azure/databricks/dbfs/dbfs-root
Apply best practices for DBFS and Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/dbfs/unity-catalog
Apply Delta Lake best practices on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/delta/best-practices
Handle Delta Lake limitations on S3 safelyhttps://learn.microsoft.com/en-us/azure/databricks/delta/s3-limitations
Use selective overwrite options with Delta Lake on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/delta/selective-overwrite
Apply recommended CI/CD workflows on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/ci-cd/flows
View Databricks policy families via CLIhttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/policy-families-commands
Develop Databricks Apps using supported frameworks and patternshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/app-development
Apply best practices for Databricks Appshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/best-practices
Advanced configuration and usage of Databricks Connecthttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/advanced
Test Databricks Connect Python code with pytesthttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/testing
Handle asynchronous queries and interruptions in Databricks Connecthttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/queries
Test Databricks Connect Scala code with ScalaTesthttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/testing
Call Databricks REST API with performance best practiceshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/rest-api
Apply Databricks developer and CI/CD best practiceshttps://learn.microsoft.com/en-us/azure/databricks/developers/best-practices
Choose between Unity Catalog volumes and workspace fileshttps://learn.microsoft.com/en-us/azure/databricks/files/files-recommendations
Store and reference Databricks init scripts in workspace fileshttps://learn.microsoft.com/en-us/azure/databricks/files/workspace-init-scripts
Curate effective Genie Agents for accurate answershttps://learn.microsoft.com/en-us/azure/databricks/genie-agents/best-practices
Apply prompt and context best practices for Genie Codehttps://learn.microsoft.com/en-us/azure/databricks/genie-code/tips
Deep clone managed Iceberg tables in Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/iceberg/clone
Apply Azure Databricks Auto Loader best practiceshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/best-practices
Configure Azure Databricks Auto Loader for productionhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/production
Apply common COPY INTO data loading patternshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/examples
Celigo connector FAQ and usage guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/celigo-faq
Apply common patterns to Lakeflow ingestion pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/common-patterns
Apply Confluence connector behaviors and FAQshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-faq
CrowdStrike Falcon Event Stream connector FAQhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/crowdstrike-falcon-event-stream-faq
Apply Dynamics 365 connector FAQs and behaviorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/d365-faq
Safely fully refresh Lakeflow target tableshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/full-refresh
Apply Glean connector FAQs and usage guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/glean-faq
Use Gmail connector FAQs and behavior guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/gmail-faq
Apply MySQL connector usage best practiceshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-faq
Use Oracle integrated CDC connector FAQs and tipshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/oracle-faq
Apply PostgreSQL connector FAQs and guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-faq
Maintain PostgreSQL ingestion pipelines in productionhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-maintenance
Optimize incremental ingestion of Salesforce formula fieldshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-formula-fields
Use Zerobus acknowledgment callbacks effectivelyhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-callbacks
Choose Zerobus blocking methods for durabilityhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-message-blocking
Implement resilient Zerobus recovery patternshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-recovery
Design Zerobus schemas for evolving datahttps://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-schema-management
Use and configure Databricks cluster init scriptshttps://learn.microsoft.com/en-us/azure/databricks/init-scripts/
Reference external files in Databricks init scriptshttps://learn.microsoft.com/en-us/azure/databricks/init-scripts/referencing-files
Test applications using the legacy Simba JDBC Driverhttps://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc/testing
Test Databricks ODBC driver connections in codehttps://learn.microsoft.com/en-us/azure/databricks/integrations/odbc/testing
Diagnose and optimize Lakeflow Jobs performancehttps://learn.microsoft.com/en-us/azure/databricks/jobs/diagnose-job-performance
Schedule recurring SQL queries with backfill in Jobshttps://learn.microsoft.com/en-us/azure/databricks/jobs/how-to/create-recurring-job
Configure classic compute for Databricks Lakeflow Jobshttps://learn.microsoft.com/en-us/azure/databricks/jobs/run-classic-jobs
Apply Databricks cost optimization best practiceshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/best-practices
Implement best practices for Databricks data and AI governancehttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/best-practices
Design observability and monitoring strategy for Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/observability
Apply interoperability and usability best practices on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/best-practices
Implement operational excellence best practices for Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/best-practices
Implement performance efficiency best practices for Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/best-practices
Implement reliability best practices for Databricks workloadshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/best-practices
Implement Databricks security, compliance, and privacy best practiceshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/security-compliance-and-privacy/best-practices
Apply Databricks well-architected best practices across pillarshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/well-architected
Classify documents with large label taxonomieshttps://learn.microsoft.com/en-us/azure/databricks/large-language-models/classify-documents-labels-tutorial
Optimize pipeline clusters with enhanced autoscalinghttps://learn.microsoft.com/en-us/azure/databricks/ldp/auto-scaling
Apply Lakeflow pipeline design best practiceshttps://learn.microsoft.com/en-us/azure/databricks/ldp/best-practices/
Design Lakeflow pipelines for safe retrieshttps://learn.microsoft.com/en-us/azure/databricks/ldp/best-practices/processing-guarantees
Apply production readiness checks to Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/best-practices/production-readiness
Use REPLACE WHERE flows for targeted recomputeshttps://learn.microsoft.com/en-us/azure/databricks/ldp/dbsql/flows-replace-where
Apply data quality expectations in pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-expectations
Apply advanced expectation patterns across datasetshttps://learn.microsoft.com/en-us/azure/databricks/ldp/expectation-patterns
Perform full refreshes of streaming tables safelyhttps://learn.microsoft.com/en-us/azure/databricks/ldp/full-refresh-st
Optimize stateful streaming with watermarks in pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/stateful-processing
Use ALTER SQL safely with Lakeflow datasetshttps://learn.microsoft.com/en-us/azure/databricks/ldp/using-alter-sql
Optimize AI Runtime training performance and resiliencyhttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/guides/performance-and-resiliency
Apply Hyperopt best practices and troubleshooting on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-best-practices
Improve Databricks AutoML forecasting with covariateshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl/automl-covariate-forecast
Follow Databricks machine learning lifecycle practiceshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/concepts/ml-lifecycle
Implement point-in-time correct feature joinshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/time-series
Benchmark Databricks LLM endpoints for latency and throughputhttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/prov-throughput-run-benchmark
Prepare large datasets for distributed training on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/load-data/ddl-data
Apply recommended LLMOps workflows on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/llmops
Configure load tests for custom model serving endpointshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/configure-load-test
Validate models before Databricks Model Serving deploymenthttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-pre-deployment-validation
Monitor Databricks model quality and endpoint healthhttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/monitor-diagnose-endpoints
Optimize Databricks Model Serving endpoints for productionhttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/production-optimization
Plan and execute load testing for Databricks serving endpointshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/what-is-load-test
Tune and scale Ray clusters on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/scale-ray
Apply deep learning best practices on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/dl-best-practices
Adapt existing Apache Spark workloads to Databrickshttps://learn.microsoft.com/en-us/azure/databricks/migration/spark
Evaluate and improve agents with MLflow scorershttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/
Align MLflow LLM judges with human feedbackhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/align-judges
Create guidelines-based LLM judges in MLflowhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/concepts/judges/guidelines
Developer workflow for MLflow code-based scorershttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/custom-scorer-dev-workflow
Tutorial: Evaluate and improve MLflow GenAI agentshttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/evaluate-app
Monitor MLflow GenAI agents in productionhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/monitor-in-production
Collect human feedback and build evaluation datasetshttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/human-feedback/
Label MLflow traces during agent developmenthttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/human-feedback/dev-annotations
Enable experts to label MLflow traces with Review Apphttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/human-feedback/expert-feedback/label-existing-traces
Evaluate and compare MLflow prompt versionshttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/evaluate-prompts
Detect issues across MLflow GenAI traceshttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/observe-with-traces/analyze-traces
Apply software engineering practices to Databricks notebookshttps://learn.microsoft.com/en-us/azure/databricks/notebooks/best-practices
Run Databricks notebooks safely and efficientlyhttps://learn.microsoft.com/en-us/azure/databricks/notebooks/run-notebook
Test Databricks notebooks with built-in toolshttps://learn.microsoft.com/en-us/azure/databricks/notebooks/test-notebooks
Monitor active queries in Lakebase Postgreshttps://learn.microsoft.com/en-us/azure/databricks/oltp/projects/active-queries
Analyze Lakebase query performance historyhttps://learn.microsoft.com/en-us/azure/databricks/oltp/projects/query-performance
Apply performance optimization recommendations on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/
Use adaptive query execution on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/aqe
Decommission deprecated Bloom filter indexeshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/bloom-filters
Optimize Spark SQL queries with Databricks CBOhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/cbo
Improve read performance with Databricks disk cachehttps://learn.microsoft.com/en-us/azure/databricks/optimizations/disk-cache
Use dynamic file pruning for Delta querieshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/dynamic-file-pruning
Reduce write conflicts with row-level concurrencyhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/isolation/row-level-concurrency
Optimize Delta MERGE with low shuffle mergehttps://learn.microsoft.com/en-us/azure/databricks/optimizations/low-shuffle-merge
Use predictive I/O optimizations on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-io
Use predictive optimization for managed tableshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-optimization
Tune range join optimization on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/range-join
Diagnose Databricks Spark cost and performance in UIhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/
Handle Databricks spot instance losses effectivelyhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/losing-spot-instances
Resolve long Spark stages with a single taskhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/one-spark-task
Optimize many small Spark jobs in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/small-spark-jobs
Mitigate overloaded Spark driver on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-driver-overloaded
Detect unnecessary data rewriting in Databricks Spark writeshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-rewriting-data
Apply best practices for Partner Connect setuphttps://learn.microsoft.com/en-us/azure/databricks/partner-connect/best-practice
Configure networking for Lakehouse Federation in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/query-federation/networking
Optimize performance of Lakehouse Federation querieshttps://learn.microsoft.com/en-us/azure/databricks/query-federation/performance-recommendations
Encrypt inter-node traffic for Databricks clustershttps://learn.microsoft.com/en-us/azure/databricks/security/keys/encrypt-otw
Apply custom DNS best practices for Databricks VNetshttps://learn.microsoft.com/en-us/azure/databricks/security/network/classic/custom-dns
Use SIGNAL and RESIGNAL in Databricks SQL handlershttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/signal-stmt
Optimize Delta Lake tables with OPTIMIZE in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-optimize
Estimate distinct counts with approx_count_distincthttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/approx_count_distinct
Use session_user instead of deprecated current_userhttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/current_user
Define liquid clustering with CLUSTER BY in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-cluster-by
Use OFFSET and LIMIT for pagination in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-offset
Author effective SQL patterns for Databricks alertshttps://learn.microsoft.com/en-us/azure/databricks/sql/user/alerts/query-patterns
Apply Databricks SQL performance insights and recommendationshttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/performance-insights
Optimize Databricks SQL queries using RELY constraintshttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-optimization-constraints
Use asynchronous transformWithState for higher throughputhttps://learn.microsoft.com/en-us/azure/databricks/stateful-applications/async
Manage Structured Streaming checkpoints correctlyhttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/checkpoints
Run multiple streaming queries per Databricks clusterhttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/multiple-streams
Run Structured Streaming in production on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/production
Use real-time mode for ultra-low latency streaminghttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/
Optimize Databricks real-time streaming query performancehttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/performance
Manage and optimize stateful streaming querieshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateful-streaming
Optimize stateless Structured Streaming querieshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateless-streaming
Monitor Databricks Structured Streaming queries effectivelyhttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stream-monitoring
Apply watermarks for stateful streaming controlhttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/watermarks
Leverage data skipping for faster querieshttps://learn.microsoft.com/en-us/azure/databricks/tables/data-skipping
Optimize partition discovery for external tableshttps://learn.microsoft.com/en-us/azure/databricks/tables/external-partition-discovery
Use change data feed for Delta and Iceberg v3https://learn.microsoft.com/en-us/azure/databricks/tables/features/change-data-feed
Optimize VARIANT performance with shreddinghttps://learn.microsoft.com/en-us/azure/databricks/tables/features/variant-shredding
Use table history and time travel safelyhttps://learn.microsoft.com/en-us/azure/databricks/tables/history
Enrich Databricks tables with comments and metadatahttps://learn.microsoft.com/en-us/azure/databricks/tables/operations/custom-metadata
Safely drop or replace Databricks tables by typehttps://learn.microsoft.com/en-us/azure/databricks/tables/operations/drop-table
Optimize Delta and Iceberg table file layouthttps://learn.microsoft.com/en-us/azure/databricks/tables/operations/optimize
Use VACUUM to reclaim storage and ensure compliancehttps://learn.microsoft.com/en-us/azure/databricks/tables/operations/vacuum
Interpret table size and reclaim storage in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/tables/size
Control Delta and Iceberg data file sizeshttps://learn.microsoft.com/en-us/azure/databricks/tables/tune-file-size
Safely evolve Delta and Iceberg table schemashttps://learn.microsoft.com/en-us/azure/databricks/tables/update-schema
Aggregate data using batch, materialized views, and streaminghttps://learn.microsoft.com/en-us/azure/databricks/transform/aggregation
Design Delta Lake data models on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/transform/data-modeling
Implement joins for batch and streaming in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/transform/join
Optimize join performance on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/transform/optimize-joins
Clean and validate data on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/transform/validate
Implement session-scoped Scala and Java UDFshttps://learn.microsoft.com/en-us/azure/databricks/udf/scala
Access task context inside Databricks UDFshttps://learn.microsoft.com/en-us/azure/databricks/udf/udf-task-context
Download internet data into Azure Databricks volumeshttps://learn.microsoft.com/en-us/azure/databricks/volumes/download-internet-files

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

Expert knowledge for Azure Active Directory B2C development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when building B2C user flows/custom policies, configuring IdPs/MFA, securing APIs, automating CI/CD, or monitoring with Sentinel, and other Azure Active Directory B2C related development tasks. Not for Azure Role-based access control (use azure-rbac), Azure Information Protection (use azure-information-protection), Azure Security (use azure-security), Azure Sentinel (use azure-sentinel).

日本語の概要は準備中です。原文の説明を表示しています。

MicrosoftDocs/Agent-Skills7772026年10月11日 更新

Expert knowledge for Azure Advisor development including best practices, decision making, limits & quotas, security, configuration, and integrations & coding patterns. Use when configuring Advisor alerts/digests, managing rec states, using workbooks, Resource Graph, or RBAC for access, and other Azure Advisor related development tasks. Not for Cost Management (use azure-cost-management), Azure Monitor (use azure-monitor), Azure Policy (use azure-policy), Azure Security (use azure-security).

日本語の概要は準備中です。原文の説明を表示しています。

MicrosoftDocs/Agent-Skills7772026年10月11日 更新

Expert knowledge for Azure AI Vision development including decision making, limits & quotas, configuration, integrations & coding patterns, and deployment. Use when using Image Analysis, Read OCR containers, smart-crop thumbnails, background removal, or video frame analysis, and other Azure AI Vision related development tasks. Not for Azure AI Custom Vision (use azure-custom-vision), Azure AI Video Indexer (use azure-video-indexer), Azure AI Document Intelligence (use azure-document-intelligence), Azure AI Immersive Reader (use azure-immersive-reader).

日本語の概要は準備中です。原文の説明を表示しています。

MicrosoftDocs/Agent-Skills7772026年10月11日 更新

Expert knowledge for Azure Kubernetes Service Edge Essentials development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when managing AKS Edge/Hybrid with Arc, GitOps, IoT/OPC/ONVIF, TPM/Key Vault secrets, or AI model workloads, and other Azure Kubernetes Service Edge Essentials related development tasks. Not for Azure Kubernetes Service (AKS) (use azure-kubernetes-service), Azure IoT Edge (use azure-iot-edge), Azure Stack Edge (use azure-stack-edge), Azure Container Apps (use azure-container-apps).

日本語の概要は準備中です。原文の説明を表示しています。

MicrosoftDocs/Agent-Skills7772026年10月11日 更新

Expert knowledge for Azure Analysis Services development including troubleshooting. Use when resolving server connectivity, firewall/VNet, DNS, client connection, or network error issues, and other Azure Analysis Services related development tasks. Not for Azure Synapse Analytics (use azure-synapse-analytics), Azure SQL Database (use azure-sql-database), Azure SQL Managed Instance (use azure-sql-managed-instance), SQL Server on Azure Virtual Machines (use azure-sql-virtual-machines).

日本語の概要は準備中です。原文の説明を表示しています。

MicrosoftDocs/Agent-Skills7772026年10月11日 更新

Expert knowledge for Azure AI Anomaly Detector development including troubleshooting, best practices, limits & quotas, configuration, and deployment. Use when tuning Docker-based Anomaly Detector, ACI or IoT Edge deployments, univariate/multivariate APIs, or service limits, and other Azure AI Anomaly Detector related development tasks. Not for Azure AI Metrics Advisor (use azure-metrics-advisor), Azure Monitor (use azure-monitor), Azure Machine Learning (use azure-machine-learning).

日本語の概要は準備中です。原文の説明を表示しています。

MicrosoftDocs/Agent-Skills7772026年10月11日 更新

MicrosoftDocs のスキルをすべて見る

このスキルの問題を報告する