Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to create table #81

Closed
luckman212 opened this issue Jul 31, 2024 · 3 comments
Closed

Unable to create table #81

luckman212 opened this issue Jul 31, 2024 · 3 comments

Comments

@luckman212
Copy link

luckman212 commented Jul 31, 2024

Nice looking project!

I'm trying to run it on an M1 Mac Mini running macOS 14.6 + Python 3.12 + a virtualenv.

I cloned the repo, created a new venv, and installed requirements.full.txt without incident.

I pointed it at a directory of .evtx files recently exported from a Windows 11 PC. The directory contains 516 files totalling 336MB.

But, it's failing during the run after Creating model:

image

Any ideas on how to debug this?

@luckman212 luckman212 changed the title Unable to create table" Unable to create table Jul 31, 2024
@wagga40
Copy link
Owner

wagga40 commented Jul 31, 2024

Hi,

Any ideas on how to debug this?

to debug, there is a --debug option and you can check (and may be share here) the output of zircolite.log.

Since you have a lot of different EVTX files, it is possible that this is a "Too many columns" error linked to a SQLite default limitation. Check this previous issue for details.

If it is that, a simple solution would be to split the number of files handled by one instance of Zircolite. For example, you create two directories with half of the EVTX in each one and run two Zircolite in parallel.

@luckman212
Copy link
Author

Thank you. I ran it again with --debug, here is the logfile:

zircolite.log

But, I did as you suggest, split the dump of evtx files into 3 separate dirs and was able to successfully process them.

@wagga40
Copy link
Owner

wagga40 commented Aug 3, 2024

Thank you.

Looking at your logs, it was indeed a "Too many columns" error :

2024-08-03 13:20:02 DEBUG    zircolite:823 executeQuery    [-] too many columns on logs

I will had something in the docs and may be a check to warn users.

PS : if you often work with a lot of logs be sure to check this section of the docs to speed up your analysis.

Thanks for sharing.

@wagga40 wagga40 closed this as completed Aug 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants