February 8, 2009 at 9:25 pm
I've been through the search and tons of bad results on google so i'm hoping i just suck and you guys have the answer here.
the company i work for has built a complex database publishing engine and we have a big challenge around the movement of data. Here's a description of our process, please reserve judgment.
A team of people enter data about the contents of documents in a series of tables by hand, most of which have auto numbers used for foreign keys and a mnemonic as a person readable unique id. we then write sql scripts and move the data into a qa region, then into a uat region and then to production. Several unrelated changes are happening at any one time with different time lines so migrations have to be very granular. sounds straightforward but trust me it's not.
We've considered lots of options like building a UI for the data entry that captures it on the way in, all entry done by sql script, selling to some huge company with too much money and let them solve it. Our latest plan is to build a sql migration engine specific that will do everything we want. it's such a huge project that we don't have the resources to begin to fathom how long it'll actually take. I'd like to buy instead.
is there some nifty software that would allow us to:
- Specify multiple migration configurations
- configurations that can build on one another like if I want to migrate a document, it uses the page configuration to move each page within the template, which uses the paragraph configuration to move each paragraph in the page.
- Find, move and match the dependent data based on rules (code or some built-in scripting) we specify rather than just foreign keys.
- Generally handle new and missing columns without requiring us to manually update all configurations (assuming they aren't primary/foreign) or require us to have the exact same schema in all regions of our software
- An API of some sort would be especially spiffy.
Thanks in advance for your help.
(if no such thing exists, does anyone else want it and how much would you pay in 2011 when we're done:) )
February 9, 2009 at 7:37 am
I am reluctant to recommend someone I don't have direct experience of but I have seen InterSystems demonstrate various integration systems (is that what you described?) so they may be helpfull to you. They are .co.uk and I have no connection with them.
cheers Tony
Viewing 2 posts - 1 through 1 (of 1 total)
You must be logged in to reply to this topic. Login to reply