Skip to content

Add PromptDA depth estimation integration #5

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 5 commits into
base: main
Choose a base branch
from
Open

Add PromptDA depth estimation integration #5

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
c8dc3df
Add PromptDA depth estimation integration
ioridev Jun 18, 2025
3a3917a
Fix depth map crash when objects are too close
ioridev Jun 23, 2025
6fd1ac7
Fix depth map processing and saving issues
ioridev Jun 23, 2025
fccb571
Add detailed technical report on depth map processing issues
ioridev Jun 23, 2025
5cd976d
Restore preview rotation for proper display orientation
ioridev Jun 23, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 11 additions & 1 deletion .claude/settings.local.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,17 @@
{
"permissions": {
"allow": [
"Bash(cat:*)"
"Bash(cat:*)",
"Bash(git checkout:*)",
"Bash(git add:*)",
"Bash(git commit:*)",
"Bash(git push:*)",
"Bash(gh pr create:*)",
"Bash(find:*)",
"Bash(ls:*)",
"Bash(grep:*)",
"Bash(mkdir:*)",
"Bash(mv:*)"
],
"deny": []
}
Expand Down
39 changes: 39 additions & 0 deletions DepthCamera.xcodeproj/project.pbxproj
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,10 @@
89B6173A2B14740B00280111 /* DepthCameraUITests.swift in Sources */ = {isa = PBXBuildFile; fileRef = 89B617392B14740B00280111 /* DepthCameraUITests.swift */; };
89B6173C2B14740B00280111 /* DepthCameraUITestsLaunchTests.swift in Sources */ = {isa = PBXBuildFile; fileRef = 89B6173B2B14740B00280111 /* DepthCameraUITestsLaunchTests.swift */; };
89DE42E22CB3DECF00D43C0A /* color 2.glb in Resources */ = {isa = PBXBuildFile; fileRef = 89DE42E12CB3DECF00D43C0A /* color 2.glb */; };
89E4CE382E0268FF003F4665 /* model_fp16.onnx in Resources */ = {isa = PBXBuildFile; fileRef = 89E4CE372E0268FF003F4665 /* model_fp16.onnx */; };
89E4CE3A2E026908003F4665 /* PromptDADepthEstimator.swift in Sources */ = {isa = PBXBuildFile; fileRef = 89E4CE392E026908003F4665 /* PromptDADepthEstimator.swift */; };
89E4CE3D2E026963003F4665 /* onnxruntime in Frameworks */ = {isa = PBXBuildFile; productRef = 89E4CE3C2E026963003F4665 /* onnxruntime */; };
89E4CE3F2E026963003F4665 /* onnxruntime_extensions in Frameworks */ = {isa = PBXBuildFile; productRef = 89E4CE3E2E026963003F4665 /* onnxruntime_extensions */; };
AF6D6D435FA0400B15234CB6 /* Pods_DepthCamera_DepthCameraUITests.framework in Frameworks */ = {isa = PBXBuildFile; fileRef = 8F9F679CF8B7EE44C3DAACAC /* Pods_DepthCamera_DepthCameraUITests.framework */; };
DB0AE426B16D9FA02B997FED /* Pods_DepthCamera.framework in Frameworks */ = {isa = PBXBuildFile; fileRef = E227FAB191BC5550BAC2DB4A /* Pods_DepthCamera.framework */; };
/* End PBXBuildFile section */
Expand Down Expand Up @@ -77,6 +81,8 @@
89B6174A2B14802900280111 /* Info.plist */ = {isa = PBXFileReference; lastKnownFileType = text.plist; path = Info.plist; sourceTree = "<group>"; };
89B8A9712BB2D33D00FD7106 /* Bridging-Header.h */ = {isa = PBXFileReference; lastKnownFileType = sourcecode.c.h; path = "Bridging-Header.h"; sourceTree = "<group>"; };
89DE42E12CB3DECF00D43C0A /* color 2.glb */ = {isa = PBXFileReference; lastKnownFileType = file; path = "color 2.glb"; sourceTree = "<group>"; };
89E4CE372E0268FF003F4665 /* model_fp16.onnx */ = {isa = PBXFileReference; lastKnownFileType = file; path = model_fp16.onnx; sourceTree = "<group>"; };
89E4CE392E026908003F4665 /* PromptDADepthEstimator.swift */ = {isa = PBXFileReference; lastKnownFileType = sourcecode.swift; path = PromptDADepthEstimator.swift; sourceTree = "<group>"; };
8F9F679CF8B7EE44C3DAACAC /* Pods_DepthCamera_DepthCameraUITests.framework */ = {isa = PBXFileReference; explicitFileType = wrapper.framework; includeInIndex = 0; path = Pods_DepthCamera_DepthCameraUITests.framework; sourceTree = BUILT_PRODUCTS_DIR; };
AC19CA33E5E5796BB47E68BF /* Pods-DepthCameraTests.release.xcconfig */ = {isa = PBXFileReference; includeInIndex = 1; lastKnownFileType = text.xcconfig; name = "Pods-DepthCameraTests.release.xcconfig"; path = "Target Support Files/Pods-DepthCameraTests/Pods-DepthCameraTests.release.xcconfig"; sourceTree = "<group>"; };
B7D605FFB229CC868C730AE8 /* Pods-DepthCamera-DepthCameraUITests.release.xcconfig */ = {isa = PBXFileReference; includeInIndex = 1; lastKnownFileType = text.xcconfig; name = "Pods-DepthCamera-DepthCameraUITests.release.xcconfig"; path = "Target Support Files/Pods-DepthCamera-DepthCameraUITests/Pods-DepthCamera-DepthCameraUITests.release.xcconfig"; sourceTree = "<group>"; };
Expand All @@ -90,7 +96,9 @@
isa = PBXFrameworksBuildPhase;
buildActionMask = 2147483647;
files = (
89E4CE3D2E026963003F4665 /* onnxruntime in Frameworks */,
DB0AE426B16D9FA02B997FED /* Pods_DepthCamera.framework in Frameworks */,
89E4CE3F2E026963003F4665 /* onnxruntime_extensions in Frameworks */,
);
runOnlyForDeploymentPostprocessing = 0;
};
Expand Down Expand Up @@ -147,6 +155,8 @@
8943625A2DF38CA900EC952D /* CaptureFileManager.swift */,
899DD70E2CF71376004FE108 /* CaptureButton.swift */,
8943625E2DF3919500EC952D /* DepthMapDetailView.swift */,
89E4CE372E0268FF003F4665 /* model_fp16.onnx */,
89E4CE392E026908003F4665 /* PromptDADepthEstimator.swift */,
899DD70C2CF7135D004FE108 /* DocumentPicker.swift */,
899DD70A2CF71336004FE108 /* ThumbnailView.swift */,
8943625C2DF38CBA00EC952D /* CaptureListView.swift */,
Expand Down Expand Up @@ -302,6 +312,9 @@
Base,
);
mainGroup = 89B617112B14740A00280111;
packageReferences = (
89E4CE3B2E026963003F4665 /* XCRemoteSwiftPackageReference "onnxruntime-swift-package-manager" */,
);
productRefGroup = 89B6171B2B14740A00280111 /* Products */;
projectDirPath = "";
projectRoot = "";
Expand All @@ -319,6 +332,7 @@
buildActionMask = 2147483647;
files = (
89DE42E22CB3DECF00D43C0A /* color 2.glb in Resources */,
89E4CE382E0268FF003F4665 /* model_fp16.onnx in Resources */,
89B617262B14740B00280111 /* Preview Assets.xcassets in Resources */,
89B617222B14740B00280111 /* Assets.xcassets in Resources */,
);
Expand Down Expand Up @@ -459,6 +473,7 @@
899DD70B2CF71336004FE108 /* ThumbnailView.swift in Sources */,
899DD70F2CF71376004FE108 /* CaptureButton.swift in Sources */,
89B6171E2B14740A00280111 /* DepthCameraApp.swift in Sources */,
89E4CE3A2E026908003F4665 /* PromptDADepthEstimator.swift in Sources */,
8943625D2DF38CBA00EC952D /* CaptureListView.swift in Sources */,
8943625F2DF3919500EC952D /* DepthMapDetailView.swift in Sources */,
);
Expand Down Expand Up @@ -843,6 +858,30 @@
defaultConfigurationName = Release;
};
/* End XCConfigurationList section */

/* Begin XCRemoteSwiftPackageReference section */
89E4CE3B2E026963003F4665 /* XCRemoteSwiftPackageReference "onnxruntime-swift-package-manager" */ = {
isa = XCRemoteSwiftPackageReference;
repositoryURL = "https://github.com/microsoft/onnxruntime-swift-package-manager";
requirement = {
kind = upToNextMajorVersion;
minimumVersion = 1.20.0;
};
};
/* End XCRemoteSwiftPackageReference section */

/* Begin XCSwiftPackageProductDependency section */
89E4CE3C2E026963003F4665 /* onnxruntime */ = {
isa = XCSwiftPackageProductDependency;
package = 89E4CE3B2E026963003F4665 /* XCRemoteSwiftPackageReference "onnxruntime-swift-package-manager" */;
productName = onnxruntime;
};
89E4CE3E2E026963003F4665 /* onnxruntime_extensions */ = {
isa = XCSwiftPackageProductDependency;
package = 89E4CE3B2E026963003F4665 /* XCRemoteSwiftPackageReference "onnxruntime-swift-package-manager" */;
productName = onnxruntime_extensions;
};
/* End XCSwiftPackageProductDependency section */
};
rootObject = 89B617122B14740A00280111 /* Project object */;
}
102 changes: 102 additions & 0 deletions DepthCamera.xcodeproj/xcshareddata/xcschemes/DepthCamera.xcscheme
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,102 @@
<?xml version="1.0" encoding="UTF-8"?>
<Scheme
LastUpgradeVersion = "1610"
version = "1.7">
<BuildAction
parallelizeBuildables = "YES"
buildImplicitDependencies = "YES"
buildArchitectures = "Automatic">
<BuildActionEntries>
<BuildActionEntry
buildForTesting = "YES"
buildForRunning = "YES"
buildForProfiling = "YES"
buildForArchiving = "YES"
buildForAnalyzing = "YES">
<BuildableReference
BuildableIdentifier = "primary"
BlueprintIdentifier = "89B617192B14740A00280111"
BuildableName = "DepthCamera.app"
BlueprintName = "DepthCamera"
ReferencedContainer = "container:DepthCamera.xcodeproj">
</BuildableReference>
</BuildActionEntry>
</BuildActionEntries>
</BuildAction>
<TestAction
buildConfiguration = "Debug"
selectedDebuggerIdentifier = "Xcode.DebuggerFoundation.Debugger.LLDB"
selectedLauncherIdentifier = "Xcode.DebuggerFoundation.Launcher.LLDB"
shouldUseLaunchSchemeArgsEnv = "YES"
shouldAutocreateTestPlan = "YES">
<Testables>
<TestableReference
skipped = "NO"
parallelizable = "YES">
<BuildableReference
BuildableIdentifier = "primary"
BlueprintIdentifier = "89B6172A2B14740B00280111"
BuildableName = "DepthCameraTests.xctest"
BlueprintName = "DepthCameraTests"
ReferencedContainer = "container:DepthCamera.xcodeproj">
</BuildableReference>
</TestableReference>
<TestableReference
skipped = "NO"
parallelizable = "YES">
<BuildableReference
BuildableIdentifier = "primary"
BlueprintIdentifier = "89B617342B14740B00280111"
BuildableName = "DepthCameraUITests.xctest"
BlueprintName = "DepthCameraUITests"
ReferencedContainer = "container:DepthCamera.xcodeproj">
</BuildableReference>
</TestableReference>
</Testables>
</TestAction>
<LaunchAction
buildConfiguration = "Debug"
selectedDebuggerIdentifier = "Xcode.DebuggerFoundation.Debugger.LLDB"
selectedLauncherIdentifier = "Xcode.DebuggerFoundation.Launcher.LLDB"
launchStyle = "0"
useCustomWorkingDirectory = "NO"
ignoresPersistentStateOnLaunch = "NO"
debugDocumentVersioning = "YES"
debugServiceExtension = "internal"
allowLocationSimulation = "YES">
<BuildableProductRunnable
runnableDebuggingMode = "0">
<BuildableReference
BuildableIdentifier = "primary"
BlueprintIdentifier = "89B617192B14740A00280111"
BuildableName = "DepthCamera.app"
BlueprintName = "DepthCamera"
ReferencedContainer = "container:DepthCamera.xcodeproj">
</BuildableReference>
</BuildableProductRunnable>
</LaunchAction>
<ProfileAction
buildConfiguration = "Release"
shouldUseLaunchSchemeArgsEnv = "YES"
savedToolIdentifier = ""
useCustomWorkingDirectory = "NO"
debugDocumentVersioning = "YES">
<BuildableProductRunnable
runnableDebuggingMode = "0">
<BuildableReference
BuildableIdentifier = "primary"
BlueprintIdentifier = "89B617192B14740A00280111"
BuildableName = "DepthCamera.app"
BlueprintName = "DepthCamera"
ReferencedContainer = "container:DepthCamera.xcodeproj">
</BuildableReference>
</BuildableProductRunnable>
</ProfileAction>
<AnalyzeAction
buildConfiguration = "Debug">
</AnalyzeAction>
<ArchiveAction
buildConfiguration = "Release"
revealArchiveInOrganizer = "YES">
</ArchiveAction>
</Scheme>
18 changes: 18 additions & 0 deletions DepthCamera.xcodeproj/xcuserdata/iori.xcuserdatad/xcschemes/xcschememanagement.plist
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,5 +10,23 @@
<integer>4</integer>
</dict>
</dict>
<key>SuppressBuildableAutocreation</key>
<dict>
<key>89B617192B14740A00280111</key>
<dict>
<key>primary</key>
<true/>
</dict>
<key>89B6172A2B14740B00280111</key>
<dict>
<key>primary</key>
<true/>
</dict>
<key>89B617342B14740B00280111</key>
<dict>
<key>primary</key>
<true/>
</dict>
</dict>
</dict>
</plist>
15 changes: 15 additions & 0 deletions DepthCamera.xcworkspace/xcshareddata/swiftpm/Package.resolved
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading