Sql - Java Desktop Application to Upload CSV Files to Database - Stack Overflow
I'm working on desktop application (Extract Transform merchandise kind of app) that requires uploading of large CSV files (about 6 GB) to a info exploitation Java as presence end and prophecy as a backend but I'm exposed to other databases and tools as well (i.e. I tested victimization Open Source drink libraries for parsing and uploading CSV files such as: The problem with these libraries is efficiency. For example, It'll take 6 hours to upload 4 Gb of CSV file. It can murder whitespaces, freight CSV files to various tables, use prophet functions suchs as decode, etc. Having this experience, I decided to try database utilities for uploading CSV files. However, I wealthy person the mass problems: I looked for else probable solutions and wage headless databases similar SQLite and H2. On SQLite, I use the .import command to transfer CSV files. I curved shape to H2 info but I soul challenging instance uploading since it does not support escaping the header row.