bulk-load

How to set parent for datastrore entity during bulkloading data by appcfg.py on Google App Engine?

I'm trying to bulkload data using appcfg.py as described here . I got it working except setting parent entity, I can't seem to find info on how to set a parent entity for entity being created by the import. Can you point me to the right direction or provide a code snippet for my bulkloader.Loader...

Large writes cause instability in Cassandra ring

I'm attempting to load a large amount of data into a 10-node Cassandra ring. The script doing the inserts gets ~4000 inserts / s, blocked presumably on network I/O. I launch 8 of these on a single machine, and the throughput scales almost linearly. (The individual throughput goes down slightly, but...

Should I use SqlBulkCopy or Stored Procedure to import data

I've got a log file which is 248 MB and it can extend up to a GB. So you can imagine how many rows there can be.I need to import all the rows into a table in an SQL Server database. For that I first create a DataTable and add all the lines in the log file into that DataTable as new rows. This...

How to save bulk records as transaction to SQL server more efficiently?

I am working on a C# MVC application. In this application user is uploading data from EXCEL spreadsheet and data is showing to grid. After it has been showing to grid, user hit 'validate data' button. Application needs to perform UI (data length, empty field, data formats, etc.) validation and...