Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rebase branch-gvfs-fuse-dev from main #5781

Merged
merged 19 commits into from
Dec 6, 2024
Merged

Rebase branch-gvfs-fuse-dev from main #5781

merged 19 commits into from
Dec 6, 2024

Conversation

diqiu50
Copy link
Contributor

@diqiu50 diqiu50 commented Dec 6, 2024

Rebase branch-gvfs-fuse-dev from main

justinmclean and others added 18 commits December 3, 2024 17:09
### What changes were proposed in this pull request?

Add column commands to the Gravitino CLI

### Why are the changes needed?

Expand Gravitino CLI.

Fix: #5383

### Does this PR introduce _any_ user-facing change?

No, but add extra commands.

### How was this patch tested?

locally.
### What changes were proposed in this pull request?

1. Release a new docker Hive image to support GCS.
2. Add related test based on the new image.
 
### Why are the changes needed?

For users convenience. 

Fix: #5673 

### Does this PR introduce _any_ user-facing change?

N/A

### How was this patch tested?

new IT `CatalogHiveGCSIT`

---------

Co-authored-by: Jerry Shao <jerryshao@datastrato.com>
…#5740)

### What changes were proposed in this pull request?

fix camelCase method names from `getfieldName` to `getFieldName`


### Why are the changes needed?

`getfieldName` is not standardized in naming


### Does this PR introduce _any_ user-facing change?

none

### How was this patch tested?

TestTableOpsUtils
…tino and paimon tables in the paimon catalog document. (#5741)

### What changes were proposed in this pull request?

Fix the binary data type mapping error of the gravitino and paimon
tables in the paimon catalog document.
### What changes were proposed in this pull request?

This is the first PR of credential vending for Gravitino server to add
credential API , please refer to #5682 for the overall workflow.
Examples to use the API:

```java
    Catalog catalog = metalake.loadCatalog(catalogName);
    Credential[] credentials =
        catalog.supportsCredentials().getCredentials();

    Credential credential =
        catalog.supportsCredentials().getCredential(“s3-token”);
```

```java
    Fileset fileset = catalog.asFilesetCatalog().loadFileset(filesetIdent);
    Credential[] credentials =
        fileset.supportsCredentials().getCredentials();
    Credential credential =
       fileset.supportsCredentials().getCredential(“s3-token”);
 
```


### Why are the changes needed?

Fix: #5619 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
using draft PR to do E2E test
…n the Gravitino CLI (#5709)

### What changes were proposed in this pull request?

Add --sortorder option to display sort order information on Tables.

### Why are the changes needed?

Closes: #5279

### Does this PR introduce _any_ user-facing change?

Yes, it adds the --sortorder option to CLI

### How was this patch tested?

Compiled and tested locally.
### What changes were proposed in this pull request?

 Add the ability to create a table via the Gravitino CLI.

### Why are the changes needed?

so we can create tables via the CLI.

Fix: #5383

### Does this PR introduce _any_ user-facing change?

No, but it expands on CLI commands.

### How was this patch tested?

Tested locally.
### What changes were proposed in this pull request?

add note for Doris type mapping

### Why are the changes needed?

Doris does support nested type in JDBC

Fix: #5098 

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

no
…gin (#5751)

### What changes were proposed in this pull request?

Add metalake name variable in the `BaseAuthorization::newPlugin()`
params.

### Why are the changes needed?

Fix: #5750

### Does this PR introduce _any_ user-facing change?

N/A

### How was this patch tested?

Add ITs.
### What changes were proposed in this pull request?

Expand Gravitino CLI support.

### Why are the changes needed?

Add support for all current catalogs.

Fix: #5560

### Does this PR introduce _any_ user-facing change?

No

### How was this patch tested?

Tested locally.
### What changes were proposed in this pull request?

Adjust table properties documentation.

### Why are the changes needed?

Add missing information about certain immutable fields and improve
readability.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Previewed the markdown output.
…5646)

### What changes were proposed in this pull request?
Implement expression from java, including:
- Expression.java
- FunctionExpression.java
- NamedReference.java
- UnparsedExpression.java
- literals/

convert to python client, and add unit test for each class.

### Why are the changes needed?

We need to support the expressions in python client

Fix: #5201

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Need to pass all unit tests.

---------

Co-authored-by: Xun <liuxun@apache.org>
…r: e.type.match (#5762)

### What changes were proposed in this pull request?

Handle unsupported column types.

### Why are the changes needed?

Fix: #5707

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Tested by opening a table containing unsupported column types (e.g.,
list, map, struct).

![image](https://github.com/user-attachments/assets/1df87e3b-8142-4001-a257-c99a390b35d9)
### What changes were proposed in this pull request?

Added simple authentication to the Gravitino CLI

### Why are the changes needed?

To support authentication.

Fix: #5384

### Does this PR introduce _any_ user-facing change?

No, but adds authentication to the CLI.

### How was this patch tested?

Tested locally.
### What changes were proposed in this pull request?

Sort options in alphabetical order.

### Why are the changes needed?

Feedback in an unrelated PR.

Fix: # N/A

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Tested locally
### What changes were proposed in this pull request?

Added OAuth support to Gravitino CLI, Note this is supported by the
configuration files.

### Why are the changes needed?

To support OAuth in the Gravitino CLI.

Fix: #5384

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Tested locally.
### What changes were proposed in this pull request?

support Aliyun oss credential provider 

### Why are the changes needed?

Fix: [# (5625)](#5625)

### How was this patch tested?

IcebergRESTOSSIT
### What changes were proposed in this pull request?

Missing param `<T>` is added to the `output` method of `Command.java`.

### Why are the changes needed?

Fix: #5772

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?
To verify, please run the following command:
```
./gradlew clean build -x test
```
After running this command, the warning `no @param for <T>` will no
longer appear.
yuqi1129
yuqi1129 previously approved these changes Dec 6, 2024
@diqiu50 diqiu50 self-assigned this Dec 6, 2024
### What changes were proposed in this pull request?

Support Kerberos authentication.

### Why are the changes needed?

To add support for Kerberos authentication.

Fix: #5384

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Tested locally.
@jerryshao jerryshao merged commit 8ab7798 into branch-gvfs-fuse-dev Dec 6, 2024
58 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.