New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add logging and error handling to punk file transfer #29

Open

mattyschell opened this issue Jul 20, 2023 · 3 comments

Assignees

Labels

Owner

mattyschell commented Jul 20, 2023 •

edited

Loading

We occasionally see the file transfer from source to target just die without erroring. It's not a big file, 500MB zipped.

The error in the createpunkreplica-replicaname-xxxx-xxx.log logs is not vebose, just

INFO:root:Creating baby publicsafety replica from D:\XX\FGDB\xxx.gdb
INFO:root:Synchronizing baby //xxx/xxx/xxxx.gdb replica from D:\xxx\xxx\xxxx.gdb

Add better logging here and maybe try, catch and re-try.

mattyschell self-assigned this

mattyschell added the enhancement label

Owner Author

mattyschell commented Jul 31, 2023

Additionally, add more info in the failure report to indicate the environment where we have issues.

Right now users must parse a message like:

Failed to replicate D:\XX\XX\xxx.gdb to //xxx-xxx.xx.nycnet/xx/xxx.gdb at 2023-07-20 00:20:58.386065

Owner Author

mattyschell commented Aug 9, 2023

Partially addressed in 61a4c1a

mattyschell added a commit that referenced this issue


          wraps punk file transfer in loving try catch addresses #29

27598ff

Owner Author

mattyschell commented Aug 10, 2023

Next up:

As we learn which activities under punkreplica.synchronize()

geodatabase-replication-toiler/src/py/punkreplica.py

Line 82 in 27598ff

def synchronize(self):

periodically fail we will wrap that particular exception to catch more details and report it out.

This is already done in the create() method here, follow the pattern

geodatabase-replication-toiler/src/py/punkreplica.py

Line 66 in 27598ff

except Exception as e:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment