Merging Sources is Painfully Slow

I’m running v5.1.2 on Windows 10 with an older Desktop (Intel i7-3770 @ 3.1GHz & 8GB RAM). My OS setup is not very customized. I have a fair sized database (about 11,000 individuals).
When I merge sources/citations, the operation runs for about 4-5 DAYS before completing (some other operations are annoyingly slow, but this one is over the top). Task Manager typically shows about 25% memory utilization for Gramps + 25 more for Windows during the operation and only 5% CPU for Gramps.
Is the main performance limitation memory, # CPUs, processor speed, or is there some system configuration that might help? Thanks hopefully,

Albert

Have you tried Gramps 5.2.4?
Install and restore backup.

One of the changes for 5.2 was eliminating excessive screen refreshes for mass changes.

So, if you deleted thousands of records, instead of doing thousands of filter view records and refresh the view, it does that once at the end. It reduced the time fot that operation from hours to a fraction of a second.

Upgrading to 5.2 is probably your best move.

Thanks. :The upgrade is simple, although until I’m willing to wait a week, I won’t know if it’s successful.

That week will be a beta version of Gramps 6.0 which should NOT be used with production trees, just test files. (Which could include a disposable copy of your production tree.) Depending on beta testing results, the earliest final release is probably a month after that. There are such deep changes that it is probably reasonable for typical users to wait for the first maintenance release. Users with a really robust backup routines might choose to live on the ‘bleeding edge.’

Gramps 5.2.x is stable, faster than 5.1.x when doing mass updates. And it is available now.

I’m not sure what you’re referring to. I meant that it takes a week to run the tool. But I’m trying to work on my computer and don’t want to be locked out.

Ah. Thought you were talking about waiting for the eagerly awaited Gramps 6.0 release.

Just for your consideration… the same test deletion of 9,000 people (from 40,000) ran for days on 5.1 before I killed the application. The same work completed in seconds (yes, less than a minute) on 5.2.3 version.

Initially, the 5.2 merge functionality doesn’t appear any faster than the 5.1, although it’s still running.
I’ll let it complete and see how it goes.

1 Like

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.