Re: How can I filter data with mongorestore in 3.0x and greater?

From: Jamie Orchard-Hays <jamieorc@xxxxxxxxx>
To: mongodb-user@xxxxxxxxxxxxxxxx
Date: Thu, 14 Apr 2016 15:44:20 -0400
Why ads?
Thanks, Daniel. The part about possible problems with non-simple Mongo datatypes is worrisome. Did you encounter any issues WRT data?

The way forward for us may be to use mongodump with - -query. The downside is that instead of one dump of everything from which I can import with filters, I’ll have to make numerous—scores of — dumps with --query and then mongorestore from each of those. It’s far less efficient for what we’re doing here. We have nightly process that take the dumped data and import filtered sets from the master set into scores of other databases. 

Jamie


On Apr 14, 2016, at 2:29 PM, Daniel Doubrovkine <dblock@xxxxxxxxxx> wrote:

We've used 2.x tools with 3.x successfully FWIW. The reason were bugs like https://jira.mongodb.org/browse/TOOLS-1039 ;<https://jira.mongodb.org/browse/TOOLS-1039>, not --filter though.

On Thu, Apr 14, 2016 at 12:20 PM, jamieorc <jamieorc@xxxxxxxxx <mailto:jamieorc@xxxxxxxxx>> wrote:
Now that mongorestore no longer has the --filter option in versions 3 and above, how does one filter data being restored? I'm relying on this feature each night to filter dumped data from one database into other databases. It's critical I find a path forward with this so that I can finish migrating to Mongo 3.x. I've had to revert to 2.6 in the meantime. 

One thought: is it possible to use 2.6 tools with 3.0 dbs? (Though the performance hit would be painful.)

Cheers,

Jamie

-- 
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
 
For other MongoDB technical support options, see: https://docs.mongodb.org/manual/support/ ;<https://docs.mongodb.org/manual/support/>
--- 
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+unsubscribe@xxxxxxxxxxxxxxxx <mailto:mongodb-user+unsubscribe@xxxxxxxxxxxxxxxx>.
To post to this group, send email to mongodb-user@xxxxxxxxxxxxxxxx <mailto:mongodb-user@xxxxxxxxxxxxxxxx>.
Visit this group at https://groups.google.com/group/mongodb-user ;<https://groups.google.com/group/mongodb-user>.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/a76f1a2b-35ac-4d5a-9317-379841ad52fd%40googlegroups.com ;<https://groups.google.com/d/msgid/mongodb-user/a76f1a2b-35ac-4d5a-9317-379841ad52fd%40googlegroups.com?utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout ;<https://groups.google.com/d/optout>.



-- 
dB. | Moscow - Geneva - Seattle - New York
 <>code.dblock.org <http://code.dblock.org/> - @dblockdotorg <http://twitter.com/#!/dblockdotorg> - artsy.net <http://artsy.net/> - github/dblock <https://github.com/dblock>

-- 
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
 
For other MongoDB technical support options, see: https://docs.mongodb.org/manual/support/ ;<https://docs.mongodb.org/manual/support/>
--- 
You received this message because you are subscribed to a topic in the Google Groups "mongodb-user" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/mongodb-user/uijlrfTRtdk/unsubscribe ;<https://groups.google.com/d/topic/mongodb-user/uijlrfTRtdk/unsubscribe>.
To unsubscribe from this group and all its topics, send an email to mongodb-user+unsubscribe@xxxxxxxxxxxxxxxx <mailto:mongodb-user+unsubscribe@xxxxxxxxxxxxxxxx>.
To post to this group, send email to mongodb-user@xxxxxxxxxxxxxxxx <mailto:mongodb-user@xxxxxxxxxxxxxxxx>.
Visit this group at https://groups.google.com/group/mongodb-user ;<https://groups.google.com/group/mongodb-user>.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CALCE7pnLr-yaZ5DK3zkwPxQrfRPSdF7zj_TDMZfyLcO4SUCNaA%40mail.gmail.com ;<https://groups.google.com/d/msgid/mongodb-user/CALCE7pnLr-yaZ5DK3zkwPxQrfRPSdF7zj_TDMZfyLcO4SUCNaA%40mail.gmail.com?utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout ;<https://groups.google.com/d/optout>.

-- 
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: https://docs.mongodb.org/manual/support/
--- 
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+unsubscribe@xxxxxxxxxxxxxxxx.
To post to this group, send email to mongodb-user@xxxxxxxxxxxxxxxx.
Visit this group at https://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/6BC251E6-91AB-46DB-83AE-342C3B402C52%40gmail.com.
For more options, visit https://groups.google.com/d/optout.
Why ads?