Final Exam: Data Transformation Using Snowpark

WHAT YOU WILL LEARN

• 

  Create and execute snowpark handlers with different names and return types
  

  perform data transformations equivalent to sql queries with group_by and order_by clauses in snowpark
  

  make standard anaconda libraries and custom python code available within a snowpark handler
  

  connect to snowflake from jupyter notebook and create and query tables using snowpark apis
  

  implement the snowpark equivalents of select, from, where, group by, and order by on dataframe objects
  

  implement union, intersect, and difference operations and joins on snowpark dataframes
  

  use the snowpark apis to create views from any dataframe object
  

  create a table with semi-structured json data and query it using snowpark
  

  outline the snowpark pandas api and contrast it with pandas and snowpark
  

  create a snowflake notebook and use snowpark pandas via the modin plugin
  

  convert snowpark pandas and snowpark dataframe objects and contrast their behaviors
  

  outline udfs, udtfs, udafs, and stored procedures and compare and contrast them
• 

  register anonymous udfs using the udf function and session.udf.register, and invoke them using call_udf
  

  register permanent udfs using the @udf decorator and then invoke them from different sessions
  

  register udfs from sql and python files
  

  register and invoke udtfs
  

  construct a udtf that normalizes denormalized json data
  

  implement the end_partition and init functions in a udtf to achieve stateful processing
  

  partition rows and sort within a partition using udtfs
  

  register and invoke udafs to perform aggregation operations
  

  implement udafs to use python objects and objects of user-defined classes
  

  identify the uses of stored procedures and contrast them with udfs, udtfs, and udafs in snowflake
  

  register and invoke stored procedures
  

  write a python function using the snowpark apis and then directly deploy it to a stored procedure