tensorboardX cause segmentation fault on import

I have a feeling it has to do with the tensorflow installation because of this ticket: