.NET for Apache Spark 101

Run Your First .NET for Apache Spark App [2 of 8]

Play Run Your First .NET for Apache Spark App [2 of 8]
rss

The Discussion

  • User profile image
    tngo
    I've followed the the video and ran into SparkContext issue. Error output below. I am missing a step somewhere? please help.

    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 WARN Utils: Service 'sparkDriver' could not bind on a random free port. You may check whether configuring an appropriate binding address.
    20/02/13 09:29:38 ERROR SparkContext: Error initializing SparkContext.
    java.net.BindException: Cannot assign requested address: bind: Service 'sparkDriver' failed after 16 retries (on a random free port)! Consider explicitly setting the appropriate binding address for the service 'sparkDriver' (for example spark.driver.bindAddress for SparkDriver) to the correct binding address.
  • User profile image
    Kaushik Ghosh

    Will we be able to leverage delta tables if we use Spark 3.0 with .NET core ? Is there a tool to chain these jobs like a chained notebook ?

Add Your 2 Cents

More episodes in this series

Related episodes