Can't import big family tree (over 24.000 people). Error 504 in GrampsWeb

When reading this thread and the experiment that @jj0192 is doing (writing an external vb tool to parsing Gramps XML and directly write a SQLite db), the thought occurs that maybe doing this import on the server might not be the best use of server time. For large trees, maybe the PostgreSQL database should be built offline and ftp uploaded, then swapped out.

Key points of Jeff’s experiments:

  • 4 days to import a a 2 million person .ged GEDCOM in Gramps for desktops.
  • 7 hours with Python to import a 2 million person .gramps XML in Gramps for desktops.
  • 16 minutes for his vb tool to parse the XML and wite the database.

Jeff mentioned how long his GECOM vb parser took took when converting to XML. But cannot seem to find that posting. But it was a whole lot less than 4 days.