We need to rewrite our existing file import process which performs inserts / updates of entities ( based on unique keys ) using either XML or flat files. Obviously SQL Server directly provides bulk import services although I'm not clear on how they help you in terms of validation of the entities as there created / updated.
I would ideally like to use LLBLGEN objects however not sure if this is feasible. We have a requirement to import a million rows in under an hour. The entity is very simple e.g. an account code consisting of
ID
Code
Description
ExternalRef ( reference for ERP system )
Active
The XML based import process simply associates a processing instruction with each entity whicih determines whether it's an
1) Insert
2) Update
3) Delete - This is just logical and doesn't actual delete the record in the database, it simply updates the entity to make the Active property false.
Only simple validation is currently performed on the entity when it's created / updated e.g. ensuring the code is unique.
Thoughts would be appreciated as I'd like to leverage LLBLGEN if at all possible so we can put all the validation logic in one place.
