Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

The reset-to-default-location doesn't seem to be working in v2 #165

Open
jkovacs-hwx opened this issue Jan 13, 2025 · 2 comments
Open

The reset-to-default-location doesn't seem to be working in v2 #165

jkovacs-hwx opened this issue Jan 13, 2025 · 2 comments
Assignees
@dstreev
Labels
bug Something isn't working

Comments

@jkovacs-hwx
Copy link

Migrating from v1 of hms-mirror to v2 found that --reset-to-default-location doesn't reset the table's location to default to DB's external location in v2.

  • checked that table is external
  • checked that DB's location is e.g. /warehouse/tablespaces/external/hive/foo.db
  • source table has /data/foo/bar and RIGHT's create table statement also has /data/foo/bar instead of /warehouse/tablespaces/external/hive/foo.db/bar

Checked with --global-location-map and mapping worked.

related command options used are:

--data-strategy SQL \
--database foo --table-filter bar \
--reset-to-default-location

Sharing logs privately...
@dstreev dstreev self-assigned this Jan 17, 2025
@dstreev dstreev added the bug Something isn't working label Jan 17, 2025
@dstreev
Copy link
Collaborator

dstreev commented Jan 17, 2025

Use the ALIGNED translationType.

Enhanced GLM to show a 'mapped' directory even though nothing changed. Allow it to prevent 'alignment' to the database.

@jkovacs-hwx
Copy link
Author

Tested --translation-type ALIGNED and works as expected (on 19.7 with the HDP3 LOC/MNGDLOC fix).
Waiting for the enhanced GLM logic for the source=target support.

dstreev added a commit to dstreev/hms-mirror that referenced this issue Jan 24, 2025
@dstreev
**What's New**
39af71d 
BETA Iceberg conversion support for the STORAGE_MIGRATION data strategy. See [Iceberg Conversion](hms-mirror-iceberg_migration.md) for more details.

**Bugs (Fixed)**
[Add to connection init the ability to set the queue AND trigger an engine resource](cloudera-labs/hms-mirror#173)
[cloudera-labs/hms-mirror#168
Validate SQL elements before making changes to the Cluster](cloudera-labs/hms-mirror#168)
[Extend the HS2 connection validation with Tez task validation](cloudera-labs/hms-mirror#167)
[The reset-to-default-location doesn't seem to be working in v2](cloudera-labs/hms-mirror#165)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dstreev dstreev

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@dstreev @jkovacs-hwx