Zchen
3c993a6268
Increase safety margin to 30% in dataset shape analysis for improved padding accuracy
2025-10-22 01:47:08 +08:00
Zchen
6fb5907c72
Refactor create_input_fn to support static shape handling for XLA compatibility
2025-10-22 01:29:31 +08:00
Zchen
c03441d8f3
Refactor dynamic padding shapes and update device placement configuration for TPU training
2025-10-22 01:03:14 +08:00
Zchen
57f07434ac
f
2025-10-22 00:54:20 +08:00
Zchen
e715d9ac79
Enhance error handling and deprecate batch generation methods in BrainToTextDatasetTF
...
- Improved error logging when loading trial data fails, ensuring correct feature dimensions in dummy data.
- Marked _create_batch_generator and create_dataset methods as deprecated, recommending create_input_fn for better performance.
- Adjusted maximum parallel workers in analyze_dataset_shapes based on CPU cores.
2025-10-22 00:28:10 +08:00
Zchen
ab12d0b7ee
f
2025-10-21 00:31:59 +08:00
Zchen
e7c9b95b00
f
2025-10-21 00:19:05 +08:00
Zchen
e399cf262a
ff
2025-10-20 13:37:11 +08:00
Zchen
06ddbc6ac2
Refactor input function to implement batch-first approach with dynamic padding and apply data augmentation post-batching for TPU compatibility
2025-10-20 00:58:29 +08:00
Zchen
fabf70cfa9
Enhance dataset shape analysis by implementing parallel processing and improving sampling logic
2025-10-20 00:35:17 +08:00
Zchen
6e02894a8a
f
2025-10-20 00:13:39 +08:00
Zchen
4db3625dc5
f
2025-10-19 23:55:56 +08:00
Zchen
4b373ab317
ff
2025-10-19 20:16:23 +08:00
Zchen
40d0fc50de
f
2025-10-19 13:18:20 +08:00
Zchen
4328114ed6
Add dataset shape analysis function and integrate into input function for TPU optimization
2025-10-19 11:04:36 +08:00
Zchen
cfd9653da9
Enhance dataset caching logic for training and validation sets with improved messaging
2025-10-19 10:31:31 +08:00
Zchen
558be0ad98
Refactor individual dataset creation for improved I/O efficiency and add logging for error handling
2025-10-19 10:31:18 +08:00
Zchen
d83f990beb
f
2025-10-17 12:20:17 +08:00
Zchen
c2661550ef
内存泄漏修复
2025-10-16 20:26:32 +08:00
Zchen
be578f2e1d
修复数据加载器低效问题
2025-10-16 17:14:06 +08:00
Zchen
0ff6634192
简单修复
2025-10-16 10:53:42 +08:00
Zchen
e8f0308fef
tpu
2025-10-15 20:45:25 +08:00
Zchen
7965f7dbfe
TPU
2025-10-15 16:55:52 +08:00
