Maven build with noredist and simulator flags failing

[rohityadavcloud]

Build on main branch is failing with:

$ mvn clean install -P developer,systemvm -Dnoredist -Dsimulator  -T8
...
[ERROR] Failed to execute goal on project cloud-plugin-network-nsx: Could not resolve dependencies for project org.apache.cloudstack:cloud-plugin-network-nsx:jar:4.20.0.0-SNAPSHOT: The following artifacts could not be resolved: com.vmware.vapi:vapi-samltoken:jar:2.40.0 (absent): com.vmware.vapi:vapi-samltoken:jar:2.40.0 was not found in https://repo.jenkins-ci.org/releases/ during a previous attempt. This failure was cached in the local repository and resolution is not reattempted until the update interval of repo.jenkins-ci.org.releases has elapsed or updates are forced -> [Help 1]
[ERROR]

ISSUE TYPE

• Bug Report

COMPONENT NAME

Build

CLOUDSTACK VERSION

main branch (4.20.0.0-snapshot)

cc @weizhouapache @nvazquez @Pearl1594

[weizhouapache]

@rohityadavcloud
which commit did you build from ?

[vishesh92]

@weizhouapache I am also facing this issue on latest main.

[weizhouapache]

@weizhouapache I am also facing this issue on latest main.

@vishesh92
for noredist packaging, you need to install some jars

          git clone https://github.com/shapeblue/cloudstack-nonoss.git nonoss
          cd nonoss && bash -x install-non-oss.sh && cd ..

cc @rohityadavcloud

[vishesh92]

@weizhouapache I am also facing this issue on latest main.

@vishesh92 for noredist packaging, you need to install some jars

          git clone https://github.com/shapeblue/cloudstack-nonoss.git nonoss
          cd nonoss && bash -x install-non-oss.sh && cd ..

I did install nonoss packages but still faced the same issue.

[weizhouapache]

@vishesh92
there are some new jars for NSX (added 7 months ago). it would be good to run the script again to ensure all jars are installed.

# From https://customerconnect.vmware.com/downloads/details?downloadGroup=NSX-4011-SDK-JAVA&productId=1324
mvn install:install-file -Dfile=nsx-java-sdk-4.1.0.2.0.jar -DgroupId=com.vmware -DartifactId=nsx-java-sdk -Dversion=4.1.0.2.0 -Dpackaging=jar
mvn install:install-file -Dfile=nsx-gpm-java-sdk-4.1.0.2.0.jar -DgroupId=com.vmware -DartifactId=nsx-gpm-java-sdk -Dversion=4.1.0.2.0 -Dpackaging=jar
mvn install:install-file -Dfile=nsx-policy-java-sdk-4.1.0.2.0.jar -DgroupId=com.vmware -DartifactId=nsx-policy-java-sdk -Dversion=4.1.0.2.0 -Dpackaging=jar

the build worked for me

$ mvn clean install -P developer,systemvm -Dnoredist -Dsimulator  -DskipTests -T4
......
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Apache CloudStack 4.20.0.0-SNAPSHOT:
[INFO] 
[INFO] Apache CloudStack Developer Tools - Checkstyle Configuration SUCCESS [  0.660 s]
[INFO] Apache CloudStack .................................. SUCCESS [  1.022 s]
[INFO] Apache CloudStack Framework - Managed Context ...... SUCCESS [  4.666 s]
[INFO] Apache CloudStack Framework ........................ SUCCESS [  0.064 s]
[INFO] Apache CloudStack Framework - Certificate Authority  SUCCESS [  2.136 s]
[INFO] Apache CloudStack Utils ............................ SUCCESS [ 10.093 s]
[INFO] Apache CloudStack Framework - Database ............. SUCCESS [ 12.380 s]
[INFO] Apache CloudStack Framework - Configuration ........ SUCCESS [  5.851 s]
[INFO] Apache CloudStack Framework - Direct Download to Primary Storage SUCCESS [  3.521 s]
[INFO] Apache CloudStack API .............................. SUCCESS [ 20.302 s]
[INFO] Apache CloudStack Framework - REST ................. SUCCESS [  4.482 s]
[INFO] Apache CloudStack Framework - IPC .................. SUCCESS [  6.413 s]
[INFO] Apache CloudStack Cloud Engine ..................... SUCCESS [  0.320 s]
[INFO] Apache CloudStack Cloud Engine API ................. SUCCESS [  5.549 s]
[INFO] Apache CloudStack Cloud Engine Schema Component .... SUCCESS [ 16.690 s]
[INFO] Apache CloudStack Framework - Security ............. SUCCESS [  3.438 s]
[INFO] Apache CloudStack Core ............................. SUCCESS [ 15.646 s]
[INFO] Apache CloudStack Agents ........................... SUCCESS [ 17.797 s]
[INFO] Apache CloudStack Framework - Clustering ........... SUCCESS [  5.906 s]
[INFO] Apache CloudStack Framework - Event Notification ... SUCCESS [  3.704 s]
[INFO] Apache CloudStack Framework - Jobs ................. SUCCESS [ 10.831 s]
[INFO] Apache CloudStack Cloud Engine Internal Components API SUCCESS [ 12.984 s]
[INFO] Apache CloudStack Agent Management Servers Load Balancer SUCCESS [  1.877 s]
[INFO] Apache CloudStack Framework - Storage Config Drive Component SUCCESS [ 12.888 s]
[INFO] Apache CloudStack Server ........................... SUCCESS [ 45.387 s]
[INFO] Apache CloudStack Framework - Quota ................ SUCCESS [ 13.498 s]
[INFO] Apache CloudStack Usage Server ..................... SUCCESS [ 13.968 s]
[INFO] Apache CloudStack Cloud Services ................... SUCCESS [  0.076 s]
[INFO] Apache CloudStack Secondary Storage ................ SUCCESS [  0.108 s]
[INFO] Apache CloudStack Secondary Storage Service ........ SUCCESS [  8.646 s]
[INFO] Apache CloudStack Engine Storage Component ......... SUCCESS [  6.135 s]
[INFO] Apache CloudStack Engine Storage Object Component .. SUCCESS [  6.523 s]
[INFO] Apache CloudStack Plugin POM ....................... SUCCESS [  1.116 s]
[INFO] Apache CloudStack Plugin - Safe Shutdown ........... SUCCESS [  9.270 s]
[INFO] Apache CloudStack Cloud Engine Orchestration Component SUCCESS [ 31.583 s]
[INFO] Apache CloudStack Cloud Engine Service ............. SUCCESS [ 12.248 s]
[INFO] Apache CloudStack Engine Storage Cache Component ... SUCCESS [  4.412 s]
[INFO] Apache CloudStack Engine Storage Image Component ... SUCCESS [  7.281 s]
[INFO] Apache CloudStack Engine Storage Volume Component .. SUCCESS [ 13.010 s]
[INFO] Apache CloudStack Engine Storage Data Motion Component SUCCESS [ 18.185 s]
[INFO] Apache CloudStack Plugin - Storage Volume Dell-EMC ScaleIO/PowerFlex Provider SUCCESS [ 19.396 s]
[INFO] Apache CloudStack Engine Storage Snapshot Component  SUCCESS [ 31.546 s]
[INFO] Apache CloudStack Engine Userdata Component ........ SUCCESS [  7.696 s]
[INFO] Apache CloudStack Engine Cloud-Init Userdata Component SUCCESS [  4.612 s]
[INFO] Apache CloudStack Plugin - ACL Dynamic Role Based .. SUCCESS [  9.377 s]
[INFO] Apache CloudStack Plugin - ACL Static Role Based ... SUCCESS [  5.450 s]
[INFO] Apache CloudStack Plugin - ACL Project Role Based .. SUCCESS [ 10.830 s]
[INFO] Apache CloudStack Plugin - Explicit Dedication Processor SUCCESS [  6.847 s]
[INFO] Apache CloudStack Plugin - Host Affinity Processor . SUCCESS [ 10.691 s]
[INFO] Apache CloudStack Plugin - Host Anti-Affinity Processor SUCCESS [  6.537 s]
[INFO] Apache CloudStack Plugin - Non-Strict Host Affinity Processor SUCCESS [ 10.974 s]
[INFO] Apache CloudStack Plugin - Non-Strict Host Anti-Affinity Processor SUCCESS [ 11.111 s]
[INFO] Apache CloudStack Plugin - SNMP Alerts ............. SUCCESS [ 10.673 s]
[INFO] Apache CloudStack Plugin - Syslog Alerts ........... SUCCESS [ 10.150 s]
[INFO] Apache CloudStack Plugin - API Discovery ........... SUCCESS [ 10.266 s]
[INFO] Apache CloudStack Plugin - API Rate Limit .......... SUCCESS [  9.995 s]
[INFO] Apache CloudStack Plugin - Storage Volume default provider SUCCESS [ 15.707 s]
[INFO] Apache CloudStack Plugin - Storage Volume SolidFire Provider SUCCESS [ 22.812 s]
[INFO] Apache CloudStack Plugin - API SolidFire Integration Testing SUCCESS [  7.461 s]
[INFO] Apache CloudStack Plugin - Dummy Backup and Recovery Plugin SUCCESS [  4.683 s]
[INFO] Apache CloudStack Plugin - Open vSwitch ............ SUCCESS [  7.823 s]
[INFO] Apache CloudStack Plugin - Tungsten-Fabric Network . SUCCESS [ 31.231 s]
[INFO] Apache CloudStack Plugin - Hypervisor KVM .......... SUCCESS [ 42.792 s]
[INFO] Apache CloudStack Plugin - EMC Networker Backup and Recovery Plugin SUCCESS [ 16.404 s]
[INFO] Apache CloudStack Plugin - Inbuilt Root Certificate Authority SUCCESS [ 12.137 s]
[INFO] Apache CloudStack Plugin - Quota Service ........... SUCCESS [ 15.604 s]
[INFO] Apache CloudStack Plugin - Dedicated Resources ..... SUCCESS [ 15.238 s]
[INFO] Apache CloudStack Plugin - Implicit Dedication Planner SUCCESS [ 14.685 s]
[INFO] Apache CloudStack Plugin - User Concentrated Pod Deployment Planner SUCCESS [  6.915 s]
[INFO] Apache CloudStack Plugin - User Dispersing Deployment Planner SUCCESS [  8.122 s]
[INFO] Apache CloudStack Plugin - Cluster DRS Algorithm - Balanced SUCCESS [ 11.033 s]
[INFO] Apache CloudStack Plugin - Cluster DRS Algorithm - Condensed SUCCESS [ 10.608 s]
[INFO] Apache CloudStack Plugin - In Memory Event Bus ..... SUCCESS [  9.575 s]
[INFO] Apache CloudStack Plugin - Kafka Event Bus ......... SUCCESS [  5.230 s]
[INFO] Apache CloudStack Plugin - RabbitMQ Event Bus ...... SUCCESS [  5.932 s]
[INFO] Apache CloudStack Plugin - Skip Heurestics Planner . SUCCESS [  5.204 s]
[INFO] Apache CloudStack Plugin - Host Allocator Random ... SUCCESS [ 10.507 s]
[INFO] Apache CloudStack Plugin - Hypervisor Baremetal .... SUCCESS [ 10.656 s]
[INFO] Apache CloudStack Plugin - Hypervisor Hyper-V ...... SUCCESS [ 16.119 s]
[INFO] Apache CloudStack Plugin - Hypervisor OracleVM3 .... SUCCESS [ 21.475 s]
[INFO] Apache CloudStack Plugin - Hypervisor OracleVM ..... SUCCESS [  8.383 s]
[INFO] Apache CloudStack Plugin - Hypervisor UCS .......... SUCCESS [  8.015 s]
[INFO] Apache CloudStack Plugin - Hypervisor XenServer .... SUCCESS [ 29.422 s]
[INFO] Apache CloudStack Plugin - Cloudian Connector ...... SUCCESS [ 12.155 s]
[INFO] Apache CloudStack Plugin - Prometheus Exporter ..... SUCCESS [  7.677 s]
[INFO] Apache CloudStack Plugin - Kubernetes Service ...... SUCCESS [ 19.390 s]
[INFO] Apache CloudStack Plugin - Metrics ................. SUCCESS [ 14.045 s]
[INFO] Apache CloudStack Plugin - BigSwitch Virtual Network Segment SUCCESS [ 15.448 s]
[INFO] Apache CloudStack Plugin - Dns Notifier Example .... SUCCESS [  6.691 s]
[INFO] Apache CloudStack Plugin - Network Internal Load Balancer SUCCESS [ 15.476 s]
[INFO] Apache CloudStack Framework - Spring Life Cycle .... SUCCESS [  4.995 s]
[INFO] Apache CloudStack Plugin - Network Juniper Contrail  SUCCESS [ 27.677 s]
[INFO] Apache CloudStack Plugin - Network Elastic Load Balancer SUCCESS [ 14.040 s]
[INFO] Apache CloudStack Plugin - GloboDNS ................ SUCCESS [ 14.816 s]
[INFO] Apache CloudStack Plugin - Network Netscaler ....... SUCCESS [ 11.646 s]
[INFO] Apache CloudStack Plugin - Network Nicira NVP ...... SUCCESS [ 21.568 s]
[INFO] Apache CloudStack Plugin - Network Opendaylight .... SUCCESS [ 14.311 s]
[INFO] Apache CloudStack Plugin - Palo Alto ............... SUCCESS [ 14.063 s]
[INFO] Apache CloudStack Plugin - Stratosphere SSP ........ SUCCESS [ 13.175 s]
[INFO] Apache CloudStack Plugin - Network Brocade VCS ..... SUCCESS [ 19.871 s]
[INFO] Apache CloudStack Plugin - Network VXLAN ........... SUCCESS [ 12.946 s]
[INFO] Apache CloudStack Plugin - Power Management Driver ipmitool SUCCESS [ 13.104 s]
[INFO] Apache CloudStack Plugin - Power Management Driver nested-cloudstack SUCCESS [ 11.333 s]
[INFO] Apache CloudStack Plugin - Power Management Driver Redfish SUCCESS [  6.265 s]
[INFO] Apache CloudStack Plugin - Storage Image default provider SUCCESS [  7.328 s]
[INFO] Apache CloudStack Plugin - Storage Image S3 provider SUCCESS [  8.289 s]
[INFO] Apache CloudStack Plugin - Storage Image sample provider SUCCESS [  7.184 s]
[INFO] Apache CloudStack Plugin - Storage Image Swift provider SUCCESS [  7.621 s]
[INFO] Apache CloudStack Plugin - Storage Volume CloudByte Provider SUCCESS [ 14.683 s]
[INFO] Apache CloudStack Plugin - Storage Volume Datera Provider SUCCESS [  9.871 s]
[INFO] Apache CloudStack Plugin - Storage Volume Nexenta Provider SUCCESS [ 14.778 s]
[INFO] Apache CloudStack Plugin - Storage Volume sample provider SUCCESS [  7.792 s]
[INFO] Apache CloudStack Plugin - Storage Volume Linstor provider SUCCESS [ 11.893 s]
[INFO] Apache CloudStack Plugin - Storage Volume StorPool provider SUCCESS [ 32.862 s]
[INFO] Apache CloudStack Plugin - Storage Volume Adaptive Base Provider SUCCESS [  8.172 s]
[INFO] Apache CloudStack Plugin - Storage Volume - Pure Flash Array SUCCESS [  8.113 s]
[INFO] Apache CloudStack Plugin - Storage Volume - HPE Primera SUCCESS [  7.384 s]
[INFO] Apache CloudStack Plugin - MinIO object storage provider SUCCESS [ 12.739 s]
[INFO] Apache CloudStack Plugin - Simulator object storage provider SUCCESS [ 12.445 s]
[INFO] Apache CloudStack Plugin - Storage Allocator Random  SUCCESS [  6.649 s]
[INFO] Apache CloudStack Plugin - User Authenticator LDAP . SUCCESS [ 28.624 s]
[INFO] Apache CloudStack Plugin - User Authenticator MD5 .. SUCCESS [ 13.093 s]
[INFO] Apache CloudStack Plugin - User Authenticator OAuth2 SUCCESS [ 17.340 s]
[INFO] Apache CloudStack Plugin - User Authenticator PBKDF2-SHA-256 SUCCESS [ 12.920 s]
[INFO] Apache CloudStack Plugin - User Authenticator Plain Text SUCCESS [  6.702 s]
[INFO] Apache CloudStack Plugin - User Authenticator SAML2  SUCCESS [ 15.093 s]
[INFO] Apache CloudStack Plugin - User Authenticator SHA256 Salted SUCCESS [ 11.542 s]
[INFO] Apache CloudStack Plugin - User Two Factor Authenticator TOTP SUCCESS [  5.670 s]
[INFO] Apache CloudStack Plugin - User Two Factor Authenticator Static Pin SUCCESS [  6.016 s]
[INFO] Apache CloudStack VMware Base ...................... SUCCESS [ 22.994 s]
[INFO] Apache CloudStack Plugin - Hypervisor VMware ....... SUCCESS [ 33.880 s]
[INFO] Apache CloudStack Plugin - API VMware SIOC ......... SUCCESS [  8.852 s]
[INFO] Apache CloudStack Plugin - Veeam Backup and Recovery Plugin SUCCESS [ 15.242 s]
[INFO] Apache CloudStack Plugin - Cisco VNMC .............. SUCCESS [ 15.948 s]
[INFO] Apache CloudStack Plugin - NSX Network ............. SUCCESS [ 26.150 s]
[INFO] Apache CloudStack Plugin - MySQL HA Strategy ....... SUCCESS [  6.315 s]
[INFO] Apache CloudStack Plugin - Hypervisor Simulator .... SUCCESS [ 14.669 s]
[INFO] Apache CloudStack Framework - Spring Module ........ SUCCESS [  9.375 s]
[INFO] Apache CloudStack Secondary Storage Controller ..... SUCCESS [  7.695 s]
[INFO] Apache CloudStack Console Proxy .................... SUCCESS [  0.138 s]
[INFO] Apache CloudStack Console Proxy - RDP Client ....... SUCCESS [ 12.598 s]
[INFO] Apache CloudStack Console Proxy - Server ........... SUCCESS [  8.474 s]
[INFO] Apache CloudStack System VM ........................ SUCCESS [ 26.191 s]
[INFO] Apache CloudStack Client UI ........................ SUCCESS [ 33.715 s]
[INFO] Apache CloudStack Framework - QuickCloud ........... SUCCESS [  1.516 s]
[INFO] Apache CloudStack Test ............................. SUCCESS [  1.014 s]
[INFO] Apache CloudStack Developer Mode ................... SUCCESS [  0.924 s]
[INFO] Apache CloudStack Developer Tools .................. SUCCESS [  0.282 s]
[INFO] Apache CloudStack apidocs .......................... SUCCESS [ 22.389 s]
[INFO] Apache CloudStack marvin ........................... SUCCESS [  3.669 s]
[INFO] Apache CloudStack DevCloud4 ........................ SUCCESS [  1.356 s]
[INFO] Apache CloudStack DevCloud-KVM ..................... SUCCESS [  1.295 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  09:44 min (Wall Clock)
[INFO] Finished at: 2024-03-25T10:15:58+01:00
[INFO] ------------------------------------------------------------------------

[vishesh92]

@rohityadavcloud which version of mvn are you using?
I was facing the same issue with mvn 3.9.6. But when I installed the nonoss packages with 3.6.3, it worked.

[rohityadavcloud]

Thanks @vishesh92 indeed my mvn version is 3.9.6, but this was on Mac:

[ERROR] Failed to execute goal on project cloud-plugin-network-nsx: Could not resolve dependencies for project org.apache.cloudstack:cloud-plugin-network-nsx:jar:4.20.0.0-SNAPSHOT: The following artifacts could not be resolved: com.vmware.vapi:vapi-samltoken:jar:2.40.0 (absent): com.vmware.vapi:vapi-samltoken:jar:2.40.0 was not found in https://repo.jenkins-ci.org/releases/ during a previous attempt. This failure was cached in the local repository and resolution is not reattempted until the update interval of repo.jenkins-ci.org.releases has elapsed or updates are forced -> [Help 1]

This is still failing for me ^^ cc @weizhouapache
cc @nvazquez @Pearl1594 if you know?

[Pearl1594]

@rohityadavcloud did you install the dependencies from the non-oss repo?

[nvazquez]

Hi @rohityadavcloud it seems like the missing jar comes as a dependency of one of the vapi jars that are on the non-oss repo (btw it works for me also):

       <dependency>
            <groupId>com.vmware.vapi</groupId>
            <artifactId>vapi-authentication</artifactId>
            <version>2.40.0</version>
        </dependency>
        <dependency>
            <groupId>com.vmware.vapi</groupId>
            <artifactId>vapi-runtime</artifactId>
            <version>2.40.0</version>
        </dependency>

[rohityadavcloud]

@Pearl1594 yes from https://github.com/shapeblue/cloudstack-nonoss main branch
@nvazquez did you add jars in some other branch (non-main)?

[slavkap]

Hi all, I was able to build it with:

  git clone https://github.com/shapeblue/cloudstack-nonoss.git nonoss
  cd nonoss && bash -x install-non-oss.sh && cd ..
  cd cloudstack
  mvn clean install -P developer,systemvm -Dnoredist -Dsimulator  -DskipTests -T4
  
  
[INFO] Apache CloudStack Plugin - NSX Network ............. SUCCESS [ 17.066 s]
[INFO] Apache CloudStack Plugin - MySQL HA Strategy ....... SUCCESS [  4.313 s]
[INFO] Apache CloudStack Plugin - Hypervisor Simulator .... SUCCESS [  7.265 s]
[INFO] Apache CloudStack Framework - Spring Module ........ SUCCESS [  7.250 s]
[INFO] Apache CloudStack Secondary Storage Controller ..... SUCCESS [  7.809 s]
[INFO] Apache CloudStack Console Proxy .................... SUCCESS [  0.056 s]
[INFO] Apache CloudStack Console Proxy - RDP Client ....... SUCCESS [  9.053 s]
[INFO] Apache CloudStack Console Proxy - Server ........... SUCCESS [  6.462 s]
[INFO] Apache CloudStack System VM ........................ SUCCESS [ 20.276 s]
[INFO] Apache CloudStack Client UI ........................ SUCCESS [ 36.773 s]
[INFO] Apache CloudStack Framework - QuickCloud ........... SUCCESS [  1.217 s]
[INFO] Apache CloudStack Test ............................. SUCCESS [  1.762 s]
[INFO] Apache CloudStack Developer Mode ................... SUCCESS [  2.411 s]
[INFO] Apache CloudStack Developer Tools .................. SUCCESS [  0.186 s]
[INFO] Apache CloudStack apidocs .......................... SUCCESS [ 23.908 s]
[INFO] Apache CloudStack marvin ........................... SUCCESS [  5.886 s]
[INFO] Apache CloudStack DevCloud4 ........................ SUCCESS [  3.118 s]
[INFO] Apache CloudStack DevCloud-KVM 4.20.0.0-SNAPSHOT ... SUCCESS [  1.164 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 07:17 min (Wall Clock)
[INFO] Finished at: 2024-04-09T15:10:44+03:00