Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Analyzer creates extremely large result for GoMod project and creates issues during scanning phase #3860

Closed
nate-droid opened this issue Apr 9, 2021 · 4 comments
Assignees
Labels
analyzer About the analyzer tool

Comments

@nate-droid
Copy link

I am currently running an Analyze on this repo. In addition to taking over 10 minutes, the result is approx 10GB in size. The entire project is about 300mb, so this seems a bit too large.

When running Scan on the results, it will take between 30-40 min before it will eventually result in java.lang.OutOfMemoryError: Java heap space. This process has been confirmed on several machines.

ort analyze -i ../path-my-project -o ../path-to-output -m GoMod
ort scan -i ../output/analyzer-result.yml -o ../output --skip-excluded

@sschuberth
Copy link
Member

Probably one cause is that we haven't ported the Go-analyzers to the new dependency graph format yet, also see #3825.

@sschuberth sschuberth added analyzer About the analyzer tool enhancement labels Apr 9, 2021
@sschuberth sschuberth changed the title Analyze Stage creates extremely large result (10gb) and creates issues during scanning phase Analyzer creates extremely large result for Go project and creates issues during scanning phase Apr 13, 2021
@sschuberth sschuberth changed the title Analyzer creates extremely large result for Go project and creates issues during scanning phase Analyzer creates extremely large result for GoMod project and creates issues during scanning phase Apr 15, 2021
@sschuberth
Copy link
Member

As a side note, please be aware that GoMod support is still marked as experimental "as only proxy-based source artifacts but no VCS locations are supported".

@sschuberth
Copy link
Member

While #4119 is already merged, #4249 still needs to be implemented to fully resolve this issue.

@fviernau
Copy link
Member

I've recently did a larger re-work of ORT's GoMod support which affected the reported dependency tree. So, I re-tested this bug with:

./cli/build/install/ort/bin/ort --info analyze -i ~/sources/github/valocode/bubbly -o . -m gomod

This took less than two minutes to execute and produced a result of size 0.16MB without any analyzer issues.
The analyzer examined revision aca7f8deb2e02c62583a5a0e3599f5c1cb096a3b.

So, the issue is fixed and this ticket can be closed as fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
analyzer About the analyzer tool
Projects
None yet
Development

No branches or pull requests

3 participants