Skip to content

File pulse connector unable to ingest Avro file with deeply nested schema and multiple complex objects are common in different nodes of the schema #712

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
hvinjarapu opened this issue Mar 24, 2025 · 0 comments
Labels
question Further information is requested

Comments

@hvinjarapu
Copy link

Does File pulse connector create avro schema based on data being passed in the input avro file all time. I have registered schema to be used into my schema registry and made auto.register.schmas as false, expected the input avro file to be ingested successfully but getting error .The gist of error is that the file pulse is comparing the schema which i published to schema registry and its internally generated schema and is giving incompatible schema error. Also when i tried creating the schema pulse is creating by looking at the connector log in the schema registry, its giving invalid schema.so unable to ingest my avro file. Point to note is i am using a deeply nested schema and there are multiple objects that are common in different nodes of the schema. Can anyone please help analyse and find root cause of the issue

@hvinjarapu hvinjarapu added the question Further information is requested label Mar 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant