QPR ProcessAnalyzer Model Datasources - Revision history

Ollvihe at 18:06, 14 November 2024

2024-11-14T18:06:11Z

← Older revision		Revision as of 18:06, 14 November 2024
Line 7:		Line 7:
	This article only concerns in-memory models - not Snowflake.		This article only concerns in-memory models - not Snowflake.
	</div>		</div>


	== Model Datasource Settings ==		== Model Datasource Settings ==

Ollvihe at 18:06, 14 November 2024

2024-11-14T18:06:05Z

← Older revision		Revision as of 18:06, 14 November 2024
Line 3:		Line 3:
	* [[#Loading Script\|Loading Script]]: Data can be loaded using a loading script written in QPR ProcessAnalyzer [[QPR_ProcessAnalyzer_Expressions\|expression language]]. The loading script can extract the data and perform needed transformations to the suitable eventlog format during model is loaded. The loading script is started when the model loading into memory starts (pull logic). With the expression language, it's also possible to fetch data from other QPR ProcessAnalyzer models.		* [[#Loading Script\|Loading Script]]: Data can be loaded using a loading script written in QPR ProcessAnalyzer [[QPR_ProcessAnalyzer_Expressions\|expression language]]. The loading script can extract the data and perform needed transformations to the suitable eventlog format during model is loaded. The loading script is started when the model loading into memory starts (pull logic). With the expression language, it's also possible to fetch data from other QPR ProcessAnalyzer models.
	* [[#ODBC Datasource\|ODBC datasources]]: Data can be loaded from any ODBC compliant source system, such as databases, SAP HANA, ServiceNow, Excel files or CSV files.		* [[#ODBC Datasource\|ODBC datasources]]: Data can be loaded from any ODBC compliant source system, such as databases, SAP HANA, ServiceNow, Excel files or CSV files.

			<div style="border:1px solid #dfdfdf;padding:0.5em 1em 0.5em 1em;background-color:#E7EAEC;margin:10px 0px 0px 10px;">
			This article only concerns in-memory models - not Snowflake.
			</div>

	== Model Datasource Settings ==		== Model Datasource Settings ==

TeeHiet: TK-54573

2024-09-30T09:14:43Z

TK-54573

← Older revision		Revision as of 09:14, 30 September 2024
Line 21:		Line 21:

	== Datatable Models ==		== Datatable Models ==
	When the ''DataSource'' is ''Datatable'', data is loaded from [[QPR_ProcessAnalyzer_Project_Workspace#Datatables\|datatables]]. Datatables can be created by importing data to them from CSV files, or they can be created by ETL scripts. Datatables can be ~~local~~ or Snowflake datatables. Note that when using Snowflake datatables, processing is done in Snowflake data cloud.		When the ''DataSource'' is ''Datatable'', data is loaded from [[QPR_ProcessAnalyzer_Project_Workspace#Datatables\|datatables]]. Datatables can be created by importing data to them from CSV files, or they can be created by ETL scripts. Datatables can be SQL Server or Snowflake datatables. Note that when using Snowflake datatables, processing is done in Snowflake data cloud.

	== Loading Script ==		== Loading Script ==

TeeHiet: TK-54573

2024-09-30T08:00:05Z

TK-54573

← Older revision		Revision as of 08:00, 30 September 2024
Line 8:		Line 8:

	Following settings are available:		Following settings are available:
	* '''Datasource''': Can be ''Datatable'' (~~local~~ or Snowflake), ''ODBC'' (data is fetched by executing an ODBC query to an OCBC datasource) or ''Loading Script'' (data is generated by running an expression language query).		* '''Datasource''': Can be ''Datatable'' (SQL Server or Snowflake), ''ODBC'' (data is fetched by executing an ODBC query to an OCBC datasource) or ''Loading Script'' (data is generated by running an expression language query).
	* '''Datatable''': When ''datasource'' is a ''datatable'', this settings defines the datatable to use.		* '''Datatable''': When ''datasource'' is a ''datatable'', this settings defines the datatable to use.
	* '''Case ID''': Defines column containing case id. This mapping is needed for both cases and events data. The column datatype can be either string or integer.		* '''Case ID''': Defines column containing case id. This mapping is needed for both cases and events data. The column datatype can be either string or integer.

TeeHiet: TK-54573

2024-09-30T07:59:20Z

TK-54573

← Older revision		Revision as of 07:59, 30 September 2024
Line 1:		Line 1:
	QPR Processanalyzer in-memory models can load data from variety of sources:		QPR Processanalyzer in-memory models can load data from variety of sources:
	* [[#Datatable Models\|Datatables]]: Data can be loaded from QPR ProcessAnalyzer [[QPR_ProcessAnalyzer_Project_Workspace#Managing_Datatables\|datatables]], located either in ~~the local data storage~~ or in Snowflake.		* [[#Datatable Models\|Datatables]]: Data can be loaded from QPR ProcessAnalyzer [[QPR_ProcessAnalyzer_Project_Workspace#Managing_Datatables\|datatables]], located either in SQL Server or in Snowflake.
	* [[#Loading Script\|Loading Script]]: Data can be loaded using a loading script written in QPR ProcessAnalyzer [[QPR_ProcessAnalyzer_Expressions\|expression language]]. The loading script can extract the data and perform needed transformations to the suitable eventlog format during model is loaded. The loading script is started when the model loading into memory starts (pull logic). With the expression language, it's also possible to fetch data from other QPR ProcessAnalyzer models.		* [[#Loading Script\|Loading Script]]: Data can be loaded using a loading script written in QPR ProcessAnalyzer [[QPR_ProcessAnalyzer_Expressions\|expression language]]. The loading script can extract the data and perform needed transformations to the suitable eventlog format during model is loaded. The loading script is started when the model loading into memory starts (pull logic). With the expression language, it's also possible to fetch data from other QPR ProcessAnalyzer models.
	* [[#ODBC Datasource\|ODBC datasources]]: Data can be loaded from any ODBC compliant source system, such as databases, SAP HANA, ServiceNow, Excel files or CSV files.		* [[#ODBC Datasource\|ODBC datasources]]: Data can be loaded from any ODBC compliant source system, such as databases, SAP HANA, ServiceNow, Excel files or CSV files.

Ollvihe at 12:52, 18 January 2024

2024-01-18T12:52:10Z

← Older revision		Revision as of 12:52, 18 January 2024
Line 14:		Line 14:
	* '''Event Time''': Defines column containing event timestamp. This mapping is needed for events data. The column datatype must be date.		* '''Event Time''': Defines column containing event timestamp. This mapping is needed for events data. The column datatype must be date.
	* '''Connection String''': ODBC connection string used to fetch cases/events data. Connection string depends on the data source type and suitable connection strings can be found e.g. in https://www.connectionstrings.com.		* '''Connection String''': ODBC connection string used to fetch cases/events data. Connection string depends on the data source type and suitable connection strings can be found e.g. in https://www.connectionstrings.com.
	* '''Connection String Key''': [[~~Secure Strings~~\|~~Secure string key~~]] of the ODBC connection string. Alternative to the ''Connection String''.		* '''Connection String Key''': [[Storing_Secrets_for_Scripts\|Secret name]] of the ODBC connection string. Alternative to the ''Connection String''.
	* '''ODBC Query''': ODBC query to run in the datasource to fetch cases/events data. Query syntax depends on the source system where the data is fetched from.		* '''ODBC Query''': ODBC query to run in the datasource to fetch cases/events data. Query syntax depends on the source system where the data is fetched from.
	* '''Loading Script''': Expression language script that provides cases/events data. For more information, see the examples below.		* '''Loading Script''': Expression language script that provides cases/events data. For more information, see the examples below.

Ollvihe: /* Loading Script */

2023-12-20T23:10:36Z

Loading Script

← Older revision		Revision as of 23:10, 20 December 2023
Line 28:		Line 28:
	The loading script is run in a security context where there are [[Roles_and_Permissions#Global_and_Project_Roles\|GenericRead and GenericWrite]] permissions for the project, where the loaded model is located. This means that the loading script has access to all data in the same project and also a write access e.g. to the datatables. Note that user's own permissions are not applied by the loading script. This is also when the model is loaded [[Automatic Model Loading on Server Startup\|automatically on server startup]], as in that case there is no user who initiated the loading.		The loading script is run in a security context where there are [[Roles_and_Permissions#Global_and_Project_Roles\|GenericRead and GenericWrite]] permissions for the project, where the loaded model is located. This means that the loading script has access to all data in the same project and also a write access e.g. to the datatables. Note that user's own permissions are not applied by the loading script. This is also when the model is loaded [[Automatic Model Loading on Server Startup\|automatically on server startup]], as in that case there is no user who initiated the loading.

	When loading data from an ODBC datasource, the [[PA_Configuration_database_table\|AllowExternalDatasources ~~setting~~]] needs to be enabled.		When loading data from an ODBC datasource, the [[PA_Configuration_database_table\|AllowExternalDatasources]] setting needs to be enabled.

	=== Examples ===		=== Examples ===

Ollvihe: /* Loading Script */

2023-12-20T23:10:11Z

Loading Script

← Older revision		Revision as of 23:10, 20 December 2023
Line 28:		Line 28:
	The loading script is run in a security context where there are [[Roles_and_Permissions#Global_and_Project_Roles\|GenericRead and GenericWrite]] permissions for the project, where the loaded model is located. This means that the loading script has access to all data in the same project and also a write access e.g. to the datatables. Note that user's own permissions are not applied by the loading script. This is also when the model is loaded [[Automatic Model Loading on Server Startup\|automatically on server startup]], as in that case there is no user who initiated the loading.		The loading script is run in a security context where there are [[Roles_and_Permissions#Global_and_Project_Roles\|GenericRead and GenericWrite]] permissions for the project, where the loaded model is located. This means that the loading script has access to all data in the same project and also a write access e.g. to the datatables. Note that user's own permissions are not applied by the loading script. This is also when the model is loaded [[Automatic Model Loading on Server Startup\|automatically on server startup]], as in that case there is no user who initiated the loading.

	When loading data from an ODBC datasource, ~~note also~~ the [[PA_Configuration_database_table\|AllowExternalDatasources setting]]~~, which may prevent the loading~~.		When loading data from an ODBC datasource, the [[PA_Configuration_database_table\|AllowExternalDatasources setting]] needs to be enabled.

	=== Examples ===		=== Examples ===

Ollvihe: /* Examples */

2023-10-30T15:30:49Z

Examples

← Older revision		Revision as of 15:30, 30 October 2023
Line 32:		Line 32:
	=== Examples ===		=== Examples ===
	==== Load from Snowflake datatable ====		==== Load from Snowflake datatable ====
	This example ~~is a~~ loading script ~~that~~ loads data from datatable ''MyDatatable'' located in the same project as the model. ~~This loading script~~ can be used to load data from a Snowflake datatable to ~~create~~ an in-memory model.		This example loading script loads data from datatable ''MyDatatable'' located in the same project as the model. It can be used to load data from a Snowflake datatable to an in-memory model.
	<pre>		<pre>
	Project.DatatableByName("MyDatatable").SqlDataFrame.Collect();		Project.DatatableByName("MyDatatable").SqlDataFrame.Collect();

Ollvihe: /* Load sample from model */

2023-10-30T15:28:50Z

Load sample from model

← Older revision		Revision as of 15:28, 30 October 2023
Line 46:		Line 46:
	</pre>		</pre>

	==== Load sample from model ====		==== Load sample from other model ====
	Loading script for events:		Loading script for events:
	<pre>		<pre>