How to convert Pandera Schemas to Snowflake Schemas?

[nehiljain]

Hi,

I have a bunch of pandera schemas. I am using Dagster output validation with Pandera. I also want to convert this schema to snowflake to check for column names and types in snowflake tables that map 1:1 with these schemas.

One idea that comes to mind is:

Write a pandera convert to recap schema.
Write a eq method for recap schema.
Using sqlalchemy inspect create a recap schema from the specific snowflake table and check if the two schemas are equal.

Thinking about it in this sequence.

[criccomini]

You're correct. You'd need to write a to_schema method that converts pandera schemas to Recap schemas. From there, you can do all the normal stuff with Recsp schemas like converting it to JSON schema or table DDLs.

Recap supports naive equality right now (just comparing Pydantic model fields), so == should work provided you want those semantics. For a looser sense of equality, we'll need to implement a compatible() method.