Skip to content

Create Data Source

In TAZI, you have two options to choose from when creating a new data source.

You can create the data source on the go while creating your Business Model by clicking the + New button:


When you open any solution from the Solution page, you can see that there is a section called Data Sources on the left pane. When you click that, you’ll see the data sources (if there are any) pertaining to a particular solution listed in the page. You can also click + Data Source to create a new data source:

After you choose either option to create the data source, the steps that need to be completed to create the data source are the same. Now, let’s see how to create our data source:

Data Source Type

First step is to choose the data source type. Here, File option will be selected by default but you can change it to either one of the allowed types:

  • File
  • DB
  • Kafka
  • GCS
  • S3

File

Let’s select the File as data source type and hit Next:

image-20210627154321275


Here, you can drag-and-drop the csv file to be uploaded or click the circled area to browse the file. After upload is complete, click Next:


Now, you can give your data source a name and a description to distinguish it from the rest later on. After you click the Submit button your data source will be created and listed in the Data Sources:

image-20210627155327072


When you click Preview you can see a preview of your data source:

image-20210627194907259


In the Action menu you can do the following:

  • Create Config: You can create a configuration file to be used on a Business Model for this data source.
  • Start Profiler: You can start Profiler on this data source.
  • Upload: You can upload a new file to be used as a data source. This is only available if the data source type is File.
  • Info: You can see all of the properties of the data source that you have created.
  • Edit: You can edit any of the properties of the data source.
  • Clone. You can clone the data source. This is only available if the data source type is DB.
  • Delete: You can delete the selected data source.

DB

When you select the data source type as DB when creating a new data source, you’ll be presented with the below window:


First of all, you need to select a Connection. If you have a Connection that you have created before you can select it from the drop down list. However, if you want to create a new Connection click the + button:


In this window, Mssql will be selected by default. You can change the database type to one of the followings:

  • Mssql
  • Impala
  • Oracle
  • Presto
  • BigQuery
  • Postgresql
  • Cassandra
  • Incorta
  • Snowflake
  • Databricks

When any one from the above list is chosen, you’ll be directed to set parameters belonging to a particular database type. For Mssql, these are Host, Port, User Name, Password information and etc. After setting the parameters, you click Next and see a overview of your newly created data source. You can edit the name and type in a description for your data source. When you click Submit, the data source of type DB will be created.

Kafka

When data source type is selected as Kafka, a different window where you can set configurations of your Kafka connection will be presented:


You can select an existing connection or create a new connection by clicking + button:


Here, you’ll set Kafka related parameters for your connection and click Next. In the Overview step, again, you can edit the connection name and set a description for your Kafka connection. When you click Submit, Kafka connection will be created and you’ll be directed to the previous window.

Now you can type your Topic name, choose your format type as either csv or json. When you click Next, you'll see a overview of your newly created data source. You can edit the name and type in a description for your Kafka data source. When you click Submit, the data source of type Kafka will be created.

Connections

You can add a new connection or edit one of the existing connections.