Skip to main content

Management

The Management page administers data lakes and the indexes they contain. It shows one panel per lake, with a status card for every index in that lake.

Menu path: Data Lake → Management · URL path: /dataLake/management

Task guide: Data Storage — the storage model, retention and residency.

Data Lake Management page showing the Add Data Lake button and the managed lake panel containing eight index cards, some green and some red

Page Layout​

From top to bottom the page contains:

  • A header with the page title Data Lake and the subtitle Management of data lake and the indexes associated with the lakes, with the Add Data Lake button on the right.
  • One panel per data lake. The panel header shows the lake name (managed in the example) with a trash button at the panel's right edge.
  • Inside the panel, a grid of index cards — one per index in the lake, listed alphabetically.
  • A Create New Index button at the bottom of the lake panel.

Header Actions​

Add Data Lake​

Click Add Data Lake to open the Creating New Data Lake dialog, subtitled Creating a new self/ingext managed data lake:

Creating New Data Lake dialog with Lake Name, Description, and Ingext Managed fields

The dialog has two sections:

  • Details — Lake Name (required) and an optional Description. While Ingext Managed is ticked, Lake Name is filled in with managed and cannot be edited.
  • Storage — an Ingext Managed checkbox, ticked by default, that selects platform-managed storage.

Unticking Ingext Managed makes Lake Name editable and adds a required Storage Integration drop-down, for choosing the storage integration the lake is kept in:

Creating New Data Lake dialog with Ingext Managed unticked, showing an editable Lake Name and the Storage Integration drop-down

Click Save to create the lake or Cancel to close without saving.

Data Lake Panel​

Each lake panel groups the lake's indexes under the lake name. The trash button at the top right of the panel deletes the entire lake.

Delete a Data Lake​

Click the panel's trash button to open the Confirm Data Lake Delete dialog:

Confirm Data Lake Delete dialog warning that all indexes in the lake will also be lost

The dialog asks whether you are sure you want to delete the named data lake and warns that all indexes in the data lake will also be lost. Click Yes to delete or No to keep the lake.

Index Cards​

Each card summarizes one index in the lake:

  • The index name and the schema it uses (Schema: followed by the schema name).
  • An activity sparkline of recent ingest volume.
  • Last Merged and Last Imported timestamps.
  • A Queue Length counter, shown only when events are waiting to be imported.

Card color reflects index state. A card is green once the index has been merged, and red while its Last Merged value is still the zero-date placeholder Dec 31st 0000 — meaning the index exists but has never been merged. A red card may still show a real Last Imported timestamp, as the AzureSigninLogs card does in the example: data has arrived but has not yet been merged into the index. Cards whose Last Imported is also the placeholder, such as behavior and default here, have not received any data.

Every card has a red trash button. A card can also include a blue gear button (shown on the default card in the example), which manages the index's virtual tables.

Virtual Tables​

Click an index card's gear button to open the Virtual Tables dialog, subtitled View and manage virtual tables:

Virtual Tables dialog with an empty table and an Add Virtual Table action

The dialog lists the index's virtual tables in a table with Name, Schema Name, Parent Index, and Actions columns. When none exist, it reads No virtual tables available. Click + Add Virtual Table to define one, or Close to dismiss the dialog.

Delete an Index​

Click an index card's trash button to open the Confirm Delete Index dialog:

Confirm Delete Index dialog asking to confirm removing an index from the lake

The dialog asks whether you are sure you want to delete the named index from the named lake. Click Yes to delete the index or No to keep it. The same confirmation appears for whichever index card's trash button you click, naming that index.

Create New Index​

Click Create New Index at the bottom of the lake panel to open the Creating New Index dialog, subtitled Creating a new index in the data lake:

Creating New Index dialog with the lake name filled in and the Name, Description, and Schema Name fields

The dialog has two sections:

  • Lake Details — Lake Name, filled in with the lake whose panel the button belongs to; it cannot be edited here.
  • Index Details — Name (required), an optional Description, and Schema Name (required), a drop-down listing the data lake schemas, for choosing the one that defines the index's records (see Schemas).

Click Save to create the index or Cancel to close without saving.