Commit Graph

154 Commits

Author SHA1 Message Date
Scott Idem
eccd71f450 Refactor: Modularize database logic and extract core CRUD operations 2026-01-15 17:16:48 -05:00
Scott Idem
3f276a42e1 Refactor: Modularize configuration and implement robust DB bootstrap 2026-01-15 16:59:18 -05:00
Scott Idem
4b86432381 Enhance V3 CRUD: Implement Error Bubbling and Dry-Run Validation.
- Updated app/db_sql.py to capture SQL exceptions in thread-local storage for later retrieval.
- Implemented format_db_error() in app/lib_api_crud_v3.py to clean up raw MariaDB error strings.
- Added POST /v3/crud/{obj_type}/validate endpoint for dry-run payload validation.
- Updated main and nested routers to bubble up validation and database errors into the response 'meta.details' field.
- Added tests/test_v3_error_bubbling.py to verify formatting logic.
2026-01-09 16:57:54 -05:00
Scott Idem
ec4656eca9 Bug fix to make lookup_id_random_pop work again. 2026-01-07 10:02:57 -05:00
Scott Idem
c33ae332e9 refactor(sql): clean up db_sql.py by removing commented-out code and consolidating logic 2026-01-06 18:12:51 -05:00
Scott Idem
868a0060dc refactor(sql): complete modularization of search builders and ID resolution 2026-01-06 17:58:34 -05:00
Scott Idem
56fe7ed953 refactor(sql): modularize Redis and ID lookup functions 2026-01-06 17:32:22 -05:00
Scott Idem
a6a5162385 refactor(sql): modularize status and where query builders 2026-01-06 17:24:47 -05:00
Scott Idem
b5e874bd99 refactor(sql): modularize basic search query builders 2026-01-06 17:22:10 -05:00
Scott Idem
45f6303219 feat(v3): robust search wildcards, smart status filtering, and fixed ID population 2026-01-06 15:54:31 -05:00
Scott Idem
9c06b07665 Saving changes now that most things have been migrated to CRUD V3 and appear to be working. This still needs testing though. 2026-01-06 13:11:03 -05:00
Scott Idem
f5ab2118ad Fix: Enhance V3 Search with 'contains', 'startswith', 'endswith' operators and improve error reporting. 2026-01-02 20:42:19 -05:00
Scott Idem
09ec231303 Security: Implement recursion depth limits and field allowlists for Advanced Search; add reference SQL exports. 2026-01-02 19:38:37 -05:00
Scott Idem
bf16f988c5 Saving recommended updates by the Svelte Gemini agent. 2026-01-02 18:57:37 -05:00
Scott Idem
2f24a5588b Feature: Implement advanced POST-based search with recursive logical grouping and unique parameterization (Verified Working). 2026-01-02 17:09:29 -05:00
Scott Idem
f124018125 Deal with SQL MATCH better 2025-06-09 14:43:30 -04:00
Scott Idem
99a200907a Less debug when on delete 2025-05-07 18:08:25 -04:00
Scott Idem
f817773338 Added the pool_recycle back in and it will default to 1800 based on Docker aether_api_config.py. Added a retry on operational exception. 2025-05-07 17:36:38 -04:00
Scott Idem
8678e33ec2 Less debug for Redis checks 2025-01-08 12:32:23 -05:00
Scott Idem
db08388ce7 Updating the Activity Log functionality. 2024-10-23 00:53:18 -04:00
Scott Idem
1c91c92d67 Better logging. Less logging. 2024-10-09 11:17:25 -04:00
Scott Idem
30c39d58dd Trying to make the SQL connections more reliable with threads. 2024-10-08 18:45:53 -04:00
Scott Idem
50955aff3a Working on making things more reliable... WS and DB connections 2024-10-08 18:20:27 -04:00
Scott Idem
e6e7275de0 Less debug and info messages to log 2024-10-08 13:47:43 -04:00
Scott Idem
39a1c05df1 Less likely to trigger checking the JP param. 2024-10-08 13:29:27 -04:00
Scott Idem
cd0d3fe9d5 Bug fix for missing ID. Less debug as well. 2024-10-08 12:52:48 -04:00
Scott Idem
18293764fd Work on CRUD v2 and better SQL WHERE part building... I hope. 2024-08-14 14:36:07 -04:00
Scott Idem
b78d93a056 Slight bug fix for the general purpose SQL SELECT function. Also adding more maps. 2024-07-31 19:33:10 -04:00
Scott Idem
d063675736 Documentation... 2024-07-31 17:47:42 -04:00
Scott Idem
e475ec6686 Working on conversion to the obj table and everything related to that. 2024-07-31 17:23:28 -04:00
Scott Idem
eb1ef32754 Less debug 2024-06-21 15:04:18 -04:00
Scott Idem
175c84b1a6 Now with the ability to do OR with LIKE 2024-06-21 14:46:19 -04:00
Scott Idem
9140455795 Getting ready for LCI importing of pre program data 2024-06-09 18:31:16 -04:00
Scott Idem
d3f26f1696 Upgrading to fastapi .95.1 2024-04-26 13:49:48 -04:00
Scott Idem
0745ac2fd4 Minor changes and updates for AAPOR with Confex 2024-04-25 16:16:15 -04:00
Scott Idem
a41f4f0a33 Trying with READ UNCOMMITTED 2024-04-23 19:58:27 -04:00
Scott Idem
c73725170e Changed the isolation_level to REPEATABLE READ from READ COMMITTED. REPEATABLE READ is the default. 2024-04-23 19:53:35 -04:00
7d955ff90f Clean up and less debug 2024-04-07 17:31:35 -04:00
f0401d8fda Work on LIKE part of query 2024-04-07 13:59:56 -04:00
Scott Idem
2514106476 Just work 2024-03-29 19:13:49 -04:00
Scott Idem
aee0b7dbbf Work on SQLAlchemy settings 2024-03-29 14:49:42 -04:00
Scott Idem
8c3786947e Better debug info 2024-03-29 13:14:35 -04:00
Scott Idem
257edec1a7 Now with a new SQL check for ProgrammingError. This is related to multithreading usually. 2024-03-29 12:58:34 -04:00
Scott Idem
0dd3bbea73 Now handles URL params with a list for IN part of SQL SELECT 2024-03-15 16:19:30 -04:00
Scott Idem
eff1da6644 Minor changes... I guess 2024-03-08 00:24:26 -05:00
Scott Idem
45d14cc7b2 Bug fix for null results SQL SELECT 2024-03-06 19:51:38 -05:00
Scott Idem
3efc55676e Bug fix for sponsorships. Typos 2024-02-28 14:55:01 -05:00
Scott Idem
9d35418251 Minor changes to site domain related. 2024-02-22 19:12:42 -05:00
Scott Idem
d6787f9855 Minor changes. Temporarily disabled redis... 2024-02-20 19:14:05 -05:00
Scott Idem
9c92818ff9 Minor changes for testing. 2024-02-14 18:05:26 -05:00