back2source: Run pipeline for 100 macOS projects

[pombredanne]

These are special as the binaries use the Mach-O format

[chinyeungli]

Created a project list for testing purpose
macos_projects.xlsx

[tdruez]

@chinyeungli Could you update the list considering the following URLs are not available:

https://github.com/liquidx/webviewscreensaver/archive/refs/tags/v2.4.zip#from
https://github.com/bikkelbroeders/TouchBarDemoApp/archive/refs/tags/v1.6.zip#from 
https://github.com/ruslanskorb/RSKImageCropper/releases/download/4.0.0/RSKImageCropper.framework.zip#to
https://github.com/ReactiveCocoa/ReactiveViewModel/archive/refs/tags/0.3.3.zip#from
https://github.com/ReactiveCocoa/ReactiveObjC/releases/download/3.0.0/ReactiveObjC.framework.zip#to
https://github.com/Nyx0uf/qlImageSize/releases/download/2.6.1/mdImageSize.mdimporter.zip#to
https://github.com/fpillet/NSLogger/archive/refs/tags/v1.9.7.zip#from
https://github.com/alexzielenski/Mousecape/releases/download/1813/Mousecape_1813.zip#to

[chinyeungli]

Updated XLSX
macos_projects-2025-01-16.xlsx

[tdruez]

Run on the 100 projects list provided at https://github.com/user-attachments/files/18427501/macos_projects-2025-01-16.xlsx

1. Convert the macos_projects-2025-01-16.xlsx into back2source_macos_projects_list.csv

2. Batch create the projects

docker compose -f /opt/scancodeio/docker-compose.yml run --rm \
    --volume $PWD:/input-data:ro \
    web scanpipe batch-create \
    --input-list /input-data/back2source_macos_projects_list.csv \
    --pipeline map_deploy_to_develop \
    --label back2source-MacOS \
    --execute --async

3. Use the "Report" action on the filtered list of projects by "back2source-MacOS" label.

Results: back2source-report-MacOS.xlsx

[AyanSinhaMahapatra]

@chinyeungli in the latest macos files list 38 out of 119 file pairs have a .dmg file as a release_download_url. These are image files and are not supported in extractcode so we have a Unrecognized archive format error in the d2d pipeline.

We should replace them with other package archives (assuming we don't want to support these in extractcode for now?)

Any archives with binaries having application/x-mach-binary mimetype should be fine.

[chinyeungli]

updated xlsx

macos_projects-2025-04-07.xlsx

[tdruez]

Re-run following the merge of #1674

Input: back2source_macos_projects_list-2025-04-07.csv

LABEL="back2source-MacOS-v2"
INPUT="back2source_macos_projects_list-2025-04-07.csv"
PIPELINE_OPTIONS="MacOS"

docker compose -f /opt/scancodeio/docker-compose.yml run --rm \
    --volume $PWD:/input-data:ro \
    web scanpipe batch-create \
    --input-list /input-data/$INPUT \
    --pipeline map_deploy_to_develop:$PIPELINE_OPTIONS \
    --label $LABEL \
    --execute --async

Results: back2source-report-MacOS-v2-2025-06-20.xlsx

[pombredanne]

Results still need review