Subject Matter Expert Coaching#

Subject Matter Expert (SME) configuration is the process of making data accessible within ConverSight. It provides knowledge to Athena. Let’s take a brief look at how to do it using the steps provided below.

  • After creating a dataset, select Data Management from the Data Workbench menu.

../../../_images/Column_Vocabulary_Landing_Page.png

Landing Page#

  • To Train Athena, Select the dataset and go to icon in the Action column then select Configure SME.

../../../_images/Datamanagement_Page.png

Configure SME Option#

NOTE
When a dataset is initially created, the activity status will be set as Configure SME. Once the configuration is complete, the status will change to Active.

  • On selecting Configure SME, it leads you to the SME Coaching Page.

../../../_images/SME_Coaching_Page.png

SME Coaching Page#

The tabs on the SME Coaching page are crucial in teaching our Athena, they are:

  • Columns Vocabulary

  • Drill Down

  • Proactive Insights

  • Help Questions

  • Relationship

To watch the video, click on SME Coaching Overview.


Columns Vocabulary#

The Columns Vocabulary tab holds significant importance in training Athena on data. It provides crucial information about the categories and types of columns, as well as appropriate synonyms for column names to enhance Athena’s efficiency. In essence, the Column Vocabulary serves as the foundation of Athena’s knowledge.

In addition to its foundational role, the Columns Vocabulary tab also offers advanced functionalities that contribute to the generation of more efficient and accurate insights. These include options to rank columns based on their significance, as well as the ability to set critical columns and default options. These features help Athena to prioritize relevant data and streamline the analysis process, leading to faster and more accurate insights.

The Columns Vocabulary tab presents data in a tabular format, including information such as table names, column names, categories, types, unit, vocabulary, default option and action field. Additional fields are also available and can be accessed through the three dots located next to each field name. Let’s see each field.

../../../_images/Column_Vocabulary_Tab.png

Column Vocabulary Tab#

Let us explore each field and their specific functions:

Table Name

Under the Table Name, one can find a list of tables. Nonetheless, certain columns do not have a table name since they are custom fields made by users for their convenience and future reference. We will discuss this further in upcoming topic on Create Custom Field.

../../../_images/Table_Name_Field.png

Table Name#

Column Name

The Column Name field exhibits all the columns present in the dataset, including some that are highlighted which are custom field column names. Additionally, some columns have a icon to signify that they are password protected and not accessible to all users.

../../../_images/Column_Name_Field.png

Column Name#

Category

The Category field is used to assign a category to each column based on its type. The available categories include metrics, dimensions, dates and flags. Some columns may be highlighted with categories such as calculated metrics, calculated dimensions and calculated dates, indicating that they are custom fields created by users. Moreover, users may also encounter smart queries and smart columns that are also user-created.

  • Dimensions: Categorical value-containing columns should be assigned as dimensions.

  • Metrics: Columns containing aggregable values can be assigned as metrics.

  • Date: Columns containing timestamps are assigned as Date.

  • Flag: Columns containing Boolean values such as 0 and 1 or yes and no or true and false should be assigned as flags.

NOTE
Mathematical operations cannot be executed on columns with dimensional data.

../../../_images/Category_Field.png

Category#

Type

The options available in the Type field are updated based on the selected category. While the category provides a generalized classification of the column, the Type offers more specific information about the data it contains.

Category

Type Available

Metric

Quantity, Currency, Duration, Distance, Volume, Mass, Temperature, Area and Fraction

Dimension

Distance, Volume, Mass, Temperature, Area, Duration, Quantity, Id, Image, Geo, Notes, Quantity and URL

Date

DD-MM-YYYY, MM-DD-YYYY, YYYY-MM-DD, YYYY-DD-MM, DD-MM-YYYY HH:MM:SS, MM-DD-YYYY HH:MM:SS, YYYY-MM-DD HH:MM:SS, YYYY-DD-MM HH:MM:SS

Dimensional Types
  • ID: When the Type field is configured as ID, the data associated with this type is excluded from loading into the knowledge base. One option available is to convert all dimensions to ID . Which prevents the entire dataset from being loaded into knowledge base.

  • Geo: If a column contains geographical data, such as latitudes and longitudes then, assign the Type field of the column as “Geo.” This setting interprets the latitude and longitude values, pinpointing locations on the map.

  • URL: Columns containing URLs should be labeled with the URL type. When queried, Athena will retrieve the clickable links present in the respective column. If the URL is labelled with a type other than URL, it will be treated as a string.

  • Image: Image URLs should be categorized as images to view them in the image format

  • Notes: Columns containing descriptions are to be assigned type field Notes.

Unit

Similar to the Type field which is depended on the chosen Category, the Unit field is also depended on the chosen type and the unit is loaded accordingly based on the type selected previously.

Type

Unit Available

Currency

$, €, ₹, £, ¥, ₩, AED, CHF, CNY, DJF, DZD, EGP, HKD, IQD, IRR, JOD, KMF, LBP, LYD, MAD, MMK, MUR, OMR, QAR, RUB, SAR, SDG, SOS, SYP, TND, UAH, YER, R, KES, MYR, THB, KMR

Duration

Minutes, Hours, Seconds, Days, Weeks, Months, Years

Quantity

No Units Available

Distance

cm, m, km, inches, feet, yards, miles

Volume

m3, kb, mb, gb, L, mL, gal, US gal

Mass

g, mg, kg, lbs, t, kt, Mt, oz

Temperature

0C, 0F

Area

m2, sq ft, hectares, acres, yards

Fraction

%

../../../_images/Unit_Field.png

Unit#

Default

The Default field plays a critical role in making Athena work more efficiently and accurately. For example, when a user requests Athena to generate insights on revenue by year. The dataset may have different date columns like order date, delivery date and sale date. To avoid confusions, the user can set a column default to set higher priority and when a date query is given Athena refers from the default date column. Similarly default can be set for metrics and dimensions to prioritize an column.

Visibility

When the data is loaded by default, all columns in your dataset are visible. Disabling the visibility toggle for a specific column means that it will no longer be considered for training Athena and consequently, it won’t be available in Athena chat.

NOTE
Despite the visibility toggle of the column being disabled, it remains functional for creating Custom Fields.

Generate Vocabulary

The Generate Vocabulary feature allows users to obtain the nearest synonymous matches for column names when dataset details are provided. The results can be downloaded in Excel format and the generated synonyms can be imported into the dataset in generate vocabulary column.

../../../_images/gen_voc.png

Generate Vocabulary#

Vocabulary

The Vocabulary column allows us to add suitable synonyms to the column names. For example, the term consumer may have various synonyms such as customer, end user, client, buyer, purchaser and shopper. All of these could be included in the Vocabulary column as synonyms. This is primarily done to train Athena to identify and respond to diverse questions that have equivalent meanings.

../../../_images/Vocabulary_Field.png

Vocabulary Field#

../../../_images/Vocabulary_Add.png

Vocabulary Added#

Action

There are two options in the action: editing and deleting. The availability of the option is contingent upon the category of the column. Its purpose is to set up any supplementary metadata information that is required for the user interface.

  • Under the Metrics category, the page includes the ability to set precision for values. Additionally, users can determine whether the column should be summed up or an average should be taken during calculations by utilizing the Aggregation option. Finally, users have the privilege to customize the background colour and text colour for the column’s UI.

../../../_images/Action_Metrics.png

Action Page for Metrics#

  • Within the Dimensions category, the page features a toggle for Entity Clarification. When enabled, this function enables Athena to search for unknown words within the column. Furthermore, users can select a default smart column from the list to ensure that the word is matched with the entity column and functions as a filter for the selected default smart column. The users are provided with the privilege to customize the background colour and text colour of the column in the UI.

../../../_images/Action_Dimension.png

Action Page for Dimensions#

  • Under the Date category, the page includes the option to enable a financial year and select the starting month of the year. Additionally, users can customize the background colour and text colour of the column in the UI.

../../../_images/Action_Date.png

Action Page for Date#

By clicking on the icon, the use can delete the corresponding column.

Fields Option

Each field provides the user with the ability to sort in either ascending or descending order. Additionally, users can filter columns and add fields from the list of available column options.

../../../_images/Field_Option.png

Field Options#

  • Sort Ascending and Sort Descending: The options for sorting in ascending and descending order arrange the selected column in alphabetical order, depending on whether the user has chosen ascending or descending sorting.

  • Columns: When clicking on the columns, a display of all available columns that can be added to the table is presented.

../../../_images/Columns_Option.png

Available Column Fields#

These include:

Columns

Action

Rank

The Rank column is assigns rank-based preference to the column. Please note that once a Rank is assigned, any other columns with the same synonym will be disregarded.

Critical Column

The Critical columns pertain to the fundamental columns within a dataset that are utilized for performing analysis and forecasting.

Table name, Column Name, Category, Type, Unit, Default, Vocabulary

These columns are shown by default.

Data Type

The Data Type column refers to the format of the information when it is being loaded into our database and these types can’t be modified

Mode

The Mode column is utilized for sorting the data in the column in either ascending or descending order.

  • Filter: The filter option enables the user to analyze a subset of data by applying specific criteria. Once a filter is applied to a table or data range, rows that do not meet the chosen criteria can be temporarily hidden. This allows for a concentrated focus on the most pertinent data.

../../../_images/Filter_Option.png

Filter#

To watch the video, click on Columns Vocabulary.

Custom Fields#

The Custom Fields empowers users to generate their own column from existing data, incorporating an applied condition column that can be utilized in future analysis.

ConverSight offers the following Custom Fields:

  • Calculated Fields

  • Summary Fields

  • Smart Query

../../../_images/CustomFields.png

Custom Fields#

Calculated Fields#

Calculated Fields play a crucial role in the analysis and visualization of business data. They enable users to generate customized data fields tailored to their specific needs. These fields are created by applying filters and performing operations on existing data fields, allowing you to create exactly the type of information you require. The custom field created using Calculated Fields will exclusively exist within the platform and won’t be replicated in the actual database.

../../../_images/CalculatedFieldOverview.png

Calculated Field Overview#

Feature

Description

Name

Provide a name for referencing your Calculated Field.

Select Category

Choose the category of the custom field as Metric, Dimension or Date.

Formula Box

Enter operations and filters in the formula box to create the Calculated Field.

Validate Expression

Validate if the provided expression can create a Calculated Field.

Row Level

When selected, operations and filters are individually applied to each row within the column.

Save

Save your Calculated Fields by clicking the Save button.

To work and know more about these fields you can refer Calculated Fields.

To watch the video, click on Calculated Fields.

Summary Fields#

Summary Fields are used to create Smart Columns that serves as an important and valuable tool for users who need to create reports or verify inputs from multiple columns across various tables within a dataset. Normally, users would need to manually enter their queries or use a guided search with Athena, which can be a time-consuming task. However, by utilizing Smart Columns, users can consolidate all necessary columns in one place, name the query and save it for future use. This feature enables users to retrieve the group of columns using only the Summary Fields name in Athena, saving significant time and effort.The created Smart Column will exclusively exist within the platform and won’t be replicated in the actual database.

../../../_images/SummaryFields.png

Summary Fields#

NOTE
Summary Fields can retrieve outcomes from diverse tables only when a relationship exists between those tables.

To work and know more about these custom fields you can refer Summary Fields.

To watch the video, click on Summary Fields.

Smart Query#

Smart Query is a feature embedded within the ConverSight platform, engineered to simplify the process of data retrieval from a database through an intuitive interface. This advanced functionality empowers users to select tables, fields and filters, thereby constructing customized queries that yield structured tables of results. Smart Query boasts a comprehensive array of features designed to augment its efficiency and user-friendliness, differentiating it from conventional querying methods.

../../../_images/SmartQuery_overview.png

Smart Query Overview#

Feature

Description

Internal View

Allows users to access and customize the dataset available in the platform’s database.

External View

Provides users with the capability to access datasets originating from the client database using Connectors.

Name

Mandatory field for specifying the name of your smart query.

View Type

Materialized View loads the dataset into the knowledge graph, while Reference creates a non-loaded view.

Query Bar

Enter a query to retrieve a table. Use ‘@’ to list columns and ‘#’ to list tables from the database.

Format Query

Formats the given query for better understanding.

Validate Query

Click to view the result of the query.

../../../_images/ExternalView.png

External View#

Additionally, the External view contains the following features :

Feature

Description

Select Connector

Choose the connector for your client from the available connectors list.

Procedure

Execute procedures specific to the client’s database.

SQL

Utilize SQL queries to fetch data as needed.

To work and know more about these fields you can refer Smart Query.

To watch the video, click on Creating Smart Query.

Export and Import

The user can export the dataset to an Excel file and import data from Excel by utilizing the export and import options.

../../../_images/Export_and_Import.png

Export and Import#

Save and Publish

  • When you have finished configuring the SME coaching settings, save your changes by clicking on Save and then click the Publish button in the Columns Vocabulary tab to make the changes live. This will ensure that your customized settings and configurations are applied to your dataset.

../../../_images/Save_and_Publish.png

Save and Publish#

Drill Down#

Drill Down is an essential feature that allows users to move from a summarized view of data to a more detailed view and it is commonly used in charts, graphs and tables. Initially, the high-level data displayed is an aggregation of different sets of data and it maintains a hierarchy. By clicking on the Drill Down option, users can access a hierarchical view that progressively delves deeper into the column until it reaches its individual and final unit. This feature helps users to gain a more thorough understanding of their data.

../../../_images/Drill_Down_Page.png

Drill Down Page#

To watch the video, click on Drill Down.

How to Create a Drill Down

  • By clicking on the icon enables users to both edit existing Drill Down structures and create new ones. Clicking on the icon will also display a list of available columns within the dataset on left side of the page.

../../../_images/Drill_Down_Columns.png

List of Available Columns#

  • Users can drag and drop the columns onto the screen for which user intended to establish a hierarchy. On the left-hand side, the arrows enable the user to shift the structure horizontally, vertically or diagonally. Meanwhile, the symbols on the right-hand side can be utilized to minimize or maximize the size of the structure.

../../../_images/Drag_Dropped_Columns.png

Drag and Dropped Columns#

  • To create a connection between two columns, users can click on the dragged and dropped column name and select the arrow icon from the displayed icons.

../../../_images/Column_Drill_Down_option.png

Drag and Dropped Columns#

  • The columns can be connected by the user dragging the arrow and clicking on the arrow, the corresponding icon allows for the removal or editing of the arrow.

../../../_images/Arrow_Edit_Option.png

Arrow Options#

  • Additionally, if a column is no longer required, users can utilize the delete icon to remove it from the hierarchy.

../../../_images/Delete_column_Drill_Down.png

Delete A Column#

  • Click on Save button to save your changes and go to Column Vocabulary page and click on Publish Button To publish the changes

Proactive Insights#

Proactive Insights tab efforts lead to the generation of insights, which are then presented in a tabular format. Insights created from Proactive Insights are brought to life and showcased on the screen of insights, providing a glimpse into the future.

../../../_images/Proactive_insight.png

Proactive Insight#

To watch the video, click on Generating Proactive Insights.

Create a New Insight#

  • To create an Insights, click –>CREATE NEW

../../../_images/Proactive_insight_Create_button.png

Create New Page#

../../../_images/Proactive_Create_new.png

Create New#

  • The CREATE NEW tab allows users to incorporate fresh insights into their project. In order to do so, they must supply a Question or Query which is then assessed to determine its output. Once the Question or Query has been entered, users may evaluate it by clicking on the designated button.

../../../_images/Proactive_Question_tab.png

Question#

  • The Inference Textbox contains the criteria that trigger the alert response template for insight sets. Users have the flexibility to personalize and tailor the condition to their preferences and requirements. By typing “@” symbol, users can retrieve a list of synonyms that correspond to their Question or Query. The user can validate their condition of their input by selecting the Validate button.

../../../_images/Proactive_inference.png

Column Vocabulary#

  • The Response Textbox is utilized to input a template that will be displayed alongside the Insight Charts. The Response Textbox acts as alert response template for the user. This information serves as an additional source of knowledge for the user and includes the column-generated values that are denoted by “@” followed by the respective column name.

  • The Follow-up Question Textbox is designed for users to enter a question that is likely to arise after viewing the output of an insight. Users have the freedom to create their own Follow-up Question, which can then be evaluated for its accuracy of their question.

../../../_images/Proactive_filled_form.png

Response and Follow-up Question#

  • The Security Textbox displays all available roles associated with the data set, allowing users to grant permission to view insights by selecting the appropriate role and assigns multiple roles to insights. Users have the option to assign the created insights to specific modules that they choose in the Module text box. The Module is to decide where the insights should be displayed And click Save to create a new Insight.

../../../_images/Proactive_Security.png

Security Module Save#

Edit#

The user has the option to modify an existing insight by clicking on the Edit icon associated with that insight. This function also enables the user to create a copy of the existing insight. If a column containing evaluated or validated data is edited, the user must evaluate and validate the column again to save the changes.

../../../_images/Proactive_edit.png

Edit#

Additionally, the user can easily clone an insight by simply clicking on the Clone button.

../../../_images/Proactive_clone.png

Clone#

Delete#

The Delete icon provides the user with the ability to delete an insight simply by clicking on it.

../../../_images/Proactive_delete.png

Delete#

To Publish Proactive Insight Components#

To access the publish Proactive Insights Components, click on the Eye icon, which will direct you to the publish window. In this window, you can view the group and role access, the status of proactive insights for those groups or roles, the Executed response to display, the creation and last updated details. The status displayed is dependent on the access granted to the respective roles and groups. If the status is listed as “success”, you may activate the insight by toggling the activation button and then selecting PUBLISH. Insights are generated for each user’s individual based on their access roles and groups.

../../../_images/Proactive_eye.png
../../../_images/Proactive_publish.png

Publish#

Tag#

Tags are employed to classify insights and determine their appropriate category or business area to display. The addition of Tags to your insight is possible by clicking on the edit icon.

../../../_images/Proactive_tag_icon.png

Tag#

../../../_images/Proactive_tag.png

New Tag#

Run a Proactive Insight#

If you wish to run proactive insights from the current status, you can select the desired insight from the table and then click on Run. On the other hand, if you wish to re-run the insight from the first of its status, select the insight and check the box labelled Re-Run Converse and then click on the Run button.

../../../_images/Proactive_insight_run.png

Run#

../../../_images/Proactive_re_run.png

Re-Run Converse#

Help Questions#

The Help Questions tab is designed to aid the user in understanding the different types of questions that can be asked to Athena. Additionally, the user has the ability to expand the list of questions by clicking on the plus icon and adding their own questions.

../../../_images/Help_questions_add.png

Help Question Tab#

In addition to adding their own questions, the user can also add Tags to their questions by selecting the Tag icon and assigning relevant tags. These tagged questions will then be displayed under the respective tags for better organization and clarity of which category the question belongs to.

../../../_images/Help_question_tag.png

Tags#

If you wish to delete a specific question, you can do so by clicking on the trash icon associated with that question. Alternatively, if you wish to delete all questions, you can click on the Remove All button.

../../../_images/Help_questions_remove_all.png

Remove All#

After adding a question or making any other changes, the user can save their modifications by selecting the Save button.

../../../_images/Help_questions_save.png

Save#

Relationship#

To establish the relationship between data tables, navigate to the Relationship tab. The tab consists of a scrollable list of tables and their columns on the left-hand side.

../../../_images/Relationship.png

Relationship Tab#

To watch the video, click on Creating Relationships among tables.

NOTE
The utilization of metric and date columns for creating relationships is restricted.

There are two drag and drop areas for two columns, which can be used to form a relationship between tables.

../../../_images/Relationship_drag_drop.png

Drag and Drop#

NOTE
The creation of Relationships between columns within the same table is restricted.

In addition to dragging and dropping tables to form a relationship, the user can also select which join operation should be performed on the common columns between the two tables and the default join is inner join. This operation allows for more flexibility and control over the relationship being created.

../../../_images/Relationship_drag.png

Drag and Drop#

NOTE
Circular joins are prohibited due to the potential for infinite iterations during querying.

Additionally, there is a Show Suggestions option that recommends columns that have something in common.

../../../_images/Relationship_show_suggestion_icon.png

Show Suggestion Button#

../../../_images/Relationship_show_suggestion.png

Show Suggestion#

If needed, the user can clear all relationships that have been attempted by selecting the Clear All option.

../../../_images/Relationship_clear_all.png

Clear All#

User can save the change, just by clicking the Save button.

../../../_images/Relationship_save.png

Save#

The Relationship tab is a crucial feature that empowers Athena to map and retrieve data with utmost efficiency, based on the closest relationships established between different tables. In this process, Athena assigns scores to the relationship formed between tables, with a higher score indicating a closer relationship and a lower score indicating a weaker one. Ultimately, Athena displays results based on the highest scores generated by relationships between columns.

Monitor the status in the Activity Status column in the Data Workbench under Data Management. Once the status changes from Configure SME to Active, your SME configuration is complete and ready for use.

../../../_images/Activity_Status1.png

Activity Status#