[HUDI-8785] Missed set of POPULATE_META_FIELDS parameter during table initialization by Flink

[geserdugarov]

Change Logs

Currently, the following queries execution by Flink:

CREATE TABLE hudi_debug (
    id INT,
    part INT,
    desc STRING,
    PRIMARY KEY (id) NOT ENFORCED
) 
WITH (
    'connector' = 'hudi',
    'path' = '...',
    'table.type' = 'MERGE_ON_READ',
    'write.operation' = 'upsert',
    'hoodie.populate.meta.fields' = 'false'
); 

INSERT INTO hudi_debug VALUES 
    (1,100,'aaa'),
    (2,200,'bbb'); 

SELECT * FROM hudi_debug; 

would result in

org.apache.hudi.exception.HoodieException: Exception when reading log file

The reason is missed configuration of hoodie.populate.meta.fields during table initialization by Flink.

Proposed changes allow to run successfully

SELECT * FROM hudi_debug

Impact

Fixed read by Flink of data without Hudi metacolumns.

Risk level (write none, low medium or high below)

Low

Documentation Update

No need

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[danny0405]

Can we move the options resolving to OptionsResolver

[geserdugarov]

I will check it.

[geserdugarov]

Done.

[hudi-bot]

CI report:

• 772eacd Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build