ETL from MongoDB To MySQL That Gets Varying Data Types Right
The Problem: How To Migrate MongoDB When A Field Has A Few Different Data Types
There are a couple tools out there that try to solve the data migration or syncing between MongoDB and RDBMS. Only MongoSluice can handle that critical issue of varying data types. MongoDB is great that it allows your data types to vary, but it sucks when you try to migrate it or map to other fields in dbs that require fixed schema.
We ran a dataset with restaurant info. The reviews field in MongoDB had 5, 5.5 and strings (i.e., “I Loved It”). When pushing these values to SQL, there’s no way to push three data types into one. So what happens? They fail!
MongoSluice Preserves MongoDB’s Data Types for A Single Field When It Streams To RDBMS
The only tool that clearly and correctly addresses this issue is MongoSluice. Instead of assigning datatypes automatically, MongoSluice recognizes different datatypes that would have the same column header and creates a new column with the same name and appended number in order to address this issue. Now, instead of having an error or forcing a conversion to one data type, you will have three columns that maintain their original data type in MongoDB and you can control whether or not those columns ought to be merged.
Take a look!
A convenient feature of MongoSluice is its ability to quickly sync changed or new data without doing any additional work such as investigating a schema…read more
MongoSluice is great at accurately Sluicing through complex data, but it is important to have a tool that is also built for speed. MongoSluice meets…read more
The Goal: MongoSluice’s power feature is that it can accurately convert data from MongoDB (BSON) to tables — rows and columns — without any…read more