[Misc] Progress bar can provide frame-level updates

  • The progress=True feature of ctx.run() and ctx.run_udf() has been improved to provide updates on a frame-by-frame basis during a run, in the case of slow-running analyses/UDFs. The number of partitions currently being processed is now also displayed in parentheses when known. Progress bars in a Jupyter notebook can now also render as Javascript widgets where available via tqdm.auto, where the ipywidgets package is installed. (#1341)