The complaint the portal doesn't surface
It's Monday, 09:17. A Slack message from your CFO: 'The Sales dashboard looks wrong: revenue is half of what we closed last quarter.' You open the Power BI Admin Portal. The activity log shows the dataset refreshed at 06:02, status: Succeeded. Capacity: nominal. No errors, no warnings.
The actual problem: the ADF pipeline feeding the staging table ran into a schema change at 03:44 and wrote zero rows. Power BI refreshed successfully against an empty table. The portal had no way to know.
This is not a bug in the Admin Portal. It's the boundary of what it was built to do. The portal tracks Power BI events: who viewed what, whether a refresh job started and finished, what your tenant settings allow. It doesn't know what happened upstream. Understanding that boundary is what separates admins who get surprised by stakeholders from those who don't.
What is the Power BI Admin Portal?
The Power BI Admin Portal is the central administration interface for Power BI, accessible at app.powerbi.com/admin-portal. It gives admins visibility into how Power BI is configured and used across the organization. Three roles can access it: Power BI Administrator, Microsoft 365 Global Administrator, and Fabric Administrator.
A common point of confusion: the Power Platform admin center (admin.powerplatform.microsoft.com) is a separate product that governs Power Apps, Power Automate, and Dataverse. They look similar and share a Microsoft aesthetic, but they control different things. The Power BI Admin Portal is specifically for Power BI Service administration.
The portal has eight main sections: Tenant settings, Usage metrics, Users, Audit logs, Capacity settings, Embed codes, Organization visuals, and Azure connections. Each answers a different administrative question. Tenant settings govern what Power BI users can do across your organization. Usage metrics show who opens which reports. Audit logs record who did what and when. Capacity settings expose CPU and memory consumption if you're on Premium P-SKU or Fabric F-SKU.
For a team inheriting a Power BI tenant, the right starting move is to spend 30 minutes in Tenant settings to understand what your organization has allowed, then 20 minutes in the Audit logs to see what has actually happened in the past 30 days.
Power BI monitoring: what the Admin Portal tracks
The activity log is the portal's primary monitoring instrument. It records Power BI events (dataset refreshes, report views, sharing actions, permission changes) for the past 30 days. You can view it in the portal under Audit logs, or pull it programmatically via PowerShell (Get-PowerBIActivityEvent) or the REST API.
The 30-day limit is the first practical constraint. For compliance, incident reconstruction, or capacity planning beyond that window, you need to export via the API and store it externally. Many admins run a daily export script to a storage account or a dedicated dataset for this reason.
The second constraint is structural: the activity log records that a refresh succeeded, not whether the refreshed data was correct. A dataset refresh that completes in 47 seconds against an empty table looks identical to one that loads 2.3 million rows from a correctly populated staging table. Both appear as RefreshDataset with status Succeeded.
Capacity monitoring works differently. If you're on Premium or Fabric, the Capacity Metrics app (a separate app you deploy from AppSource, not a built-in portal feature) shows CPU utilization, memory pressure, and query wait times by workspace. It's useful for diagnosing throttling. What it doesn't show: whether any of those queries ran against correct data.
There is no native alerting in the Admin Portal. No thresholds, no notifications, no webhook triggers. If you want to know when a dataset refresh fails, you configure that at the dataset level in Power BI Service, not in the Admin Portal.
Usage metrics: the gap between who viewed it and whether it was correct
The usage metrics report is per workspace. Open a report in Power BI Service, select 'Usage metrics report' from the file menu (requires Build access or higher), and you'll see views, unique users, and some performance data for a rolling period.
Two limitations affect how much you can trust this data for operational decisions.
First, anonymization: if a report has fewer than 100 unique viewers, individual user data is hidden and shown only in aggregate. For internal operational reports with a small audience (board presentations, financial close processes), you may be looking at aggregate counts that tell you the report was opened but not by whom or when.
Second, there's no cross-workspace usage view in the portal itself. If you manage 30 workspaces, you'd need to open 30 usage reports individually, or build your own aggregated view using the REST API endpoint GET /admin/datasets. The portal doesn't give you a tenant-level picture of which reports are actively used versus abandoned.
For teams trying to identify stale datasets or low-usage workspaces for capacity consolidation, the REST API combined with the activity log export gets you further than the portal UI. The portal usage report is a starting point, not an operational dashboard.
Governance via the Admin Portal: tenant settings and access management
The Tenant settings section contains more than 250 individual controls. They cover what users can export (to Excel, to CSV, to PDF), whether they can publish to the web, whether Azure AD guest users can access Power BI, whether AI-assisted features are enabled, and dozens of other permissions.
For a new Power BI admin, two areas are most commonly left at insecure defaults in older tenants: 'Export and sharing settings' (which may allow public web publishing) and 'Developer settings' (which can expose embedded analytics to external parties). Spending 45 minutes reviewing these two sections when you take over a tenant is worth doing before anything else.
The audit log records changes to tenant settings. If someone enables 'Publish to web,' there's an entry. What the portal doesn't do is alert you to the change in real time. A setting changed at 23:00 on a Friday by a co-administrator shows up Monday morning when you next check, if you remember to look.
Workspace access governance is similarly passive. The Users section shows who has Power BI Pro or Premium Per User licenses. It doesn't show workspace membership or role assignments (Admin, Member, Contributor, Viewer) across workspaces. That requires the REST API or a third-party governance tool. For organizations with more than 50 workspaces, manual audit is not a realistic governance model.
Performance monitoring: where the portal stops
The Capacity Metrics app is Power BI's own performance surface for Premium and Fabric. It shows query duration percentiles, CPU consumption by workspace and dataset, and memory pressure over time. If your Premium capacity is throttling (a P1 running at 85% CPU with queries queuing), this app tells you.
Two things it doesn't tell you: whether a slow query is slow because of the data model or because the underlying data is wrong, and whether a dataset refresh completed with correct data.
For the most common class of Power BI incident ('the dashboard is showing wrong numbers'), the portal gives you three data points: the refresh ran, it took N seconds, capacity was at X%. It cannot tell you that the dataset refreshed from zero-row staging tables, that the gateway credential used for a DirectQuery connection expires in 36 hours, or that the Databricks job feeding your data ran 40 minutes late.
Many teams compensate with PowerShell. Get-PowerBIActivityEvent is the standard workaround for extracting audit log data beyond 30 days and building an operational view in a data warehouse or a dedicated monitoring dataset. It works. But it's not alerting. It's manual investigation with better data than the portal UI provides.
When the Admin Portal is enough — and when it isn't
The Admin Portal is the right primary tool when your organization has fewer than 50 workspaces, datasets refresh directly from source databases without ADF or Databricks in the middle, compliance needs are covered by the standard 30-day audit log, and no board-level dashboards depend on the morning refresh cycle.
For most enterprise Power BI environments, at least one of those conditions doesn't hold. The tenant grew past 50 workspaces, someone added an ADF pipeline, or the CFO started relying on a dataset before the 09:00 standup.
The signal that you've outgrown the portal as your primary monitoring tool is not a metric. It's a complaint. If your stakeholders have ever noticed a data problem before your data team did, the portal isn't giving you enough signal. At that point the question isn't 'how do we get more out of the portal.' It's 'what are we not monitoring that the portal structurally can't see.'
See also: Power BI monitoring tools compared
Proactive monitoring alongside the Admin Portal
MetricSign monitors the Power BI activity layer and connects it to upstream pipeline state in ADF, Databricks, dbt, and Fabric. When an ADF pipeline runs late or writes zero rows, MetricSign correlates that event with the Power BI datasets that depend on it via the lineage graph and sends an alert before the next scheduled refresh.
For the scenario at the top of this article: MetricSign would catch the zero-row write in the ADF staging table at 03:46, check lineage to identify which Power BI datasets depend on that table, and send a message to the on-call data engineer at 03:47. The 06:02 refresh could then be delayed or the team notified before the board meeting.
Honest limitation: MetricSign doesn't detect browser-side authentication errors. If a user's Power BI Desktop session has an expired AADSTS token, that's outside what the service API surfaces. For those cases, see our AADSTS error reference for Power BI scheduled refresh.
The Admin Portal remains the right tool for tenant governance and audit compliance. It shows what Power BI allows and what has happened inside Power BI. What it doesn't see is what happens between your pipelines and your datasets. That gap causes most production data incidents in organizations running a modern data stack.
MetricSign is free to start, connects to your first Power BI tenant in under 15 minutes, and doesn't require changes to your existing pipelines or datasets.
