SimPay
MasterIngestionConfig
Table Name: master_ingestion_config
Columns
| Name | Type | Nullable | Primary Key | Default |
|---|---|---|---|---|
id |
INTEGER |
False | Yes | None |
master_name |
VARCHAR(255) |
False | No | None |
source_type |
VARCHAR(5) |
False | No | None |
refresh_mode |
VARCHAR(11) |
False | No | None |
key_fields |
ARRAY |
True | No | None |
schedule |
VARCHAR(128) |
True | No | None |
last_run_at |
DATETIME |
True | No | None |
metadata |
JSONB |
True | No | None |
fail_file_on_error |
BOOLEAN |
False | No | ScalarElementColumnDefault(False) |
max_error_rate |
FLOAT |
False | No | ScalarElementColumnDefault(0.1) |
field_definitions |
JSONB |
True | No | CallableColumnDefault(<function list at 0x74c88cf66de0>) |
requires_upload |
BOOLEAN |
False | No | ScalarElementColumnDefault(False) |
target_model |
VARCHAR(255) |
True | No | None |
active |
BOOLEAN |
False | No | ScalarElementColumnDefault(True) |
validation_rules |
JSONB |
True | No | None |
expected_count_min |
INTEGER |
True | No | None |
expected_count_max |
INTEGER |
True | No | None |
error_threshold |
INTEGER |
False | No | ScalarElementColumnDefault(5) |
created_by |
VARCHAR(100) |
True | No | None |
created_at |
DATETIME |
False | No | None |
modified_by |
VARCHAR(100) |
True | No | None |
modified_at |
DATETIME |
True | No | None |
connection_config_id |
INTEGER |
True | No | None |
Data Filters
Active Filters:
Data Records
| id | master_name | source_type | refresh_mode | key_fields | schedule | last_run_at | metadata | fail_file_on_error | max_error_rate | field_definitions | requires_upload | target_model | active | validation_rules | expected_count_min | expected_count_max | error_threshold | created_by | created_at | modified_by | modified_at | connection_config_id |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | city master | excel | full | [''] | None | None | MetaData() | False | 0.1 | [{'header': 'Agreement No', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'agreement_no', 'is_filterable': False}, {'header': 'State', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'state', 'is_filterable': False}, {'header': 'Region', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'region', 'is_filterable': False}, {'header': 'City', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'city', 'is_filterable': False}, {'header': 'Product Code', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'product_code', 'is_filterable': False}, {'header': 'Product', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'product', 'is_filterable': False}, {'header': 'Current Month DPD', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'current_month_dpd', 'is_filterable': False}, {'header': 'OPN_Bucket ', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'opn_bucket', 'is_filterable': False}, {'header': 'WriteOff Date', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'writeoff_date', 'is_filterable': False}, {'header': 'Instalment Amount', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'instalment_amount', 'is_filterable': False}, {'header': 'POS', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'pos', 'is_filterable': False}, {'header': 'Allocated Team/Vertical', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'PU / FR Tagging', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'FOS ID', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'fos_id', 'is_filterable': False}, {'header': '1st Level Allocation (Agency/Officer/Executive Level) staff Id', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Designation', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'designation', 'is_filterable': False}, {'header': 'FOS Code', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'fos_code', 'is_filterable': False}, {'header': 'Instalment date', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'instalment_date', 'is_filterable': False}] | False | UrbanAllocationInput | True | None | None | None | 5 | None | 2025-10-17 07:55:55 | None | None | None |
| 2 | urban allocation | excel | full | [''] | None | None | MetaData() | False | 0.1 | [{'header': 'Agreement No', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'agreement_no', 'is_filterable': False}, {'header': 'State', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'state', 'is_filterable': False}, {'header': 'Region', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'region', 'is_filterable': False}, {'header': 'City', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'city', 'is_filterable': False}, {'header': 'Product Code', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'product_code', 'is_filterable': False}, {'header': 'Product', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'product', 'is_filterable': False}, {'header': 'Current Month DPD', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'current_month_dpd', 'is_filterable': False}, {'header': 'OPN_Bucket ', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'opn_bucket', 'is_filterable': False}, {'header': 'WriteOff Date', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'writeoff_date', 'is_filterable': False}, {'header': 'Instalment Amount', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'instalment_amount', 'is_filterable': False}, {'header': 'POS', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'pos', 'is_filterable': False}, {'header': 'Allocated Team/Vertical', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'PU / FR Tagging', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'FOS ID', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'fos_id', 'is_filterable': False}, {'header': '1st Level Allocation (Agency/Officer/Executive Level) staff Id', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Designation', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'designation', 'is_filterable': False}, {'header': 'FOS Code', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'fos_code', 'is_filterable': False}, {'header': 'Instalment date', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'instalment_date', 'is_filterable': False}] | False | UrbanAllocationInput | True | None | None | None | 5 | None | 2025-10-17 08:06:32 | None | None | None |
| 3 | YMOReceiptDumpInput | excel | full | [''] | None | None | MetaData() | False | 0.1 | [{'header': 'Loan No', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Chq/DD Date', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Type Of Transaction', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Instrument Type', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Chq/DD No', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Chq/DD Date111111', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Total Collected Amount', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'EMI Amount', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Transaction status', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Txn Date & Time', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Receipt No', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'receipt_no', 'is_filterable': False}, {'header': 'Deposit To', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Receipt Date', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'agency code ', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}] | False | YMOReceiptDumpInput | True | None | None | None | 5 | None | 2025-10-17 08:07:23 | None | None | None |
| 4 | urban settlement input | excel | full | [''] | None | None | MetaData() | False | 0.1 | [{'header': 'LAN No', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'POS Waiver Amount', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'pos_waiver_amount', 'is_filterable': False}, {'header': 'POS Waiver %', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Final Main Status', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': 'final_main_status', 'is_filterable': False}, {'header': 'AGENCY CODE ', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}] | False | UrbanSettlementInput | True | None | None | None | 5 | None | 2025-10-17 08:08:13 | None | None | None |
| 5 | Urban Live Base Input | excel | full | [''] | None | None | MetaData() | False | 0.1 | [{'header': 'LAN', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'Revise_Bucket', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}, {'header': 'AGENCY COD E', 'field_type': 'STRING', 'is_visible': True, 'is_gridable': False, 'is_included': True, 'is_required': False, 'internal_name': '', 'is_filterable': False}] | False | UrbanLiveBaseInput | True | None | None | None | 5 | None | 2025-10-17 08:14:30 | None | None | None |
Showing 1-5 of 5
Relationships
| Relationship Name | Target Model | Direction |
|---|---|---|
connection_config |
connection_configs | MANYTOONE |
file_ingestions |
file_ingestions | ONETOMANY |
expected_files |
ingestion_expected_files | ONETOMANY |
file_logs |
ingestion_file_log | ONETOMANY |
cycle_expectations |
cycle_expected_files | ONETOMANY |