Creating the target table and configuring role privileges

Creating the target table

You must pre-create a target WarehousePG (WHPG) table before you initiate a data load operation to WarehousePG (WHPG) from FlowServer. This is the table that will store your loaded and transformed Kafka or RabbitMQ data.

The name of the table, schema, database, columns, and other details must match what you have set on the YAML configuration file under the target section.

Configuring role privileges

If you load data to WHPG from FlowServer using a non-admin WHPG user/role, you must assign the role certain privileges:

• The role must have USAGE and CREATE privileges on any non-public database schema where it writes data or where FlowServer creates external tables.

  → WrapCopy

  GRANT USAGE, CREATE ON SCHEMA <schema_name> TO <role_name>;

• If the role writing to WHPG is not a database or table owner, the role must have SELECT and INSERT privileges on each WHPG table to which the role will write data.

  → WrapCopy

  GRANT SELECT, INSERT ON <schema_name>.<table_name> TO <role_name>;

• The role must have permission to create readable external tables using gpfdist protocol.

  → WrapCopy

  ALTER ROLE <role_name> CREATEEXTTABLE(type = 'readable', protocol = 'gpfdist');