spark
Here are 4,399 public repositories matching this topic...
-
Updated
Mar 4, 2020 - Go
Environment:
- Framework: PyTorch
- Framework version: 1.3.1
- Horovod version: 0.19.0
- MPI version: 4.0.2
- CUDA version: N/A
- NCCL version: N/A
- Python version: 3.7.5
- OS and version: Mac OS 10.15.2
- GCC version: 9.2.0
Checklist:
- Did you search issues to find if somebody asked this question before? Yes
- If your question is about hang, did you read [this d
If I were to deploy cube.js using AWS serverless architecture, is athena required?
The docs https://cube.dev/docs/deployment#serverless do not mention whether Athena is optional or required. But when reading it, I assume it is required because there are athena keys in the serverless.yml config. I'm evaluating the idea of using Postgres RDS as the sole datasource for cubejs.
-
Updated
Mar 4, 2020
how to define java8 when submit application use spark-submit
name: Bug report/Feature request/Question
about: Create a report to help us improve
title: ''
label: bug/enhancement/question
assignees: ''
Environment:
- Java version:
- Scala version:
- Spark version:
- PyTorch and Python version:
- OS and version:
Checklist:
- Did you check if your bug/feature/
The official Widgets Development Guide only contains the most basic widget types as example.
There is no functional example for a Flot chart in there right now. Or is it?
Since this is one of the most useful and probably used (at leat to me) widgets it would be very helpful to extend that docum
-
Updated
Mar 4, 2020 - Java
-
Updated
Mar 4, 2020 - Python
-
Updated
Mar 4, 2020 - Jupyter Notebook
Page
https://docs.alluxio.io/os/user/edge/en/deploy/Running-Alluxio-On-Kubernetes.html
Summary
The K8s deployment instructions is missing documentation for:
- Configuring tiered storage w/ helm chart
- Deploying the fuse daemonset using the helm chart
The ask for this issue is to
- create an "Example: Tiered Storage" under the section https://docs.alluxio.io/os/user/edge/en/de
File "/root/miniconda3/bin/pipeline", line 11, in <module>
sys.exit(_main())
File "/root/miniconda3/lib/python3.7/site-packages/cli_pipeline/cli_pipeline.py", line 5734, in _main
_fire.Fire()
File "/root/miniconda3/lib/python3.7/site-packages/fire/core.py", line 127, in Fire
component_trace = _Fire(component, args, context, name)
Fil
-
Updated
Mar 3, 2020 - Python
Spark 2.3 officially support run on kubernetes. While our guide of "Run on Kubernetes" is still based on a special version of Spark 2.2, which is out of date. We need to:
- update that document to Spark 2.3
- release the corresponding docker images.
-
Updated
Mar 3, 2020 - Scala
According to the generated build
The commands to launch are the following :
docker pull andypetrella/spark-notebook:0.7.0-scala-2.11.8-spark-2.1.1-hadoop-2.7.2-with-hive
docker run -p 9001:9001 andypetrella/spark-notebook:0.7.0-scala-2.11.8-spark-2.1.1-hadoop-2.7.2-with-hive
Using that image (and I think it i
Hello,
I was able to run python scripts in dev mode using the steps provided in documentation. but for production, I am not sure which all folders to keep and the process to follow. editing the local conf and local sh files and running the server_deploy script, I was able to generate the server jar. But still i had to manually add the python context and upload my egg file.
Can someone pleas
I have noticed a small error in the documentation around S3 configurations:
https://docs.delta.io/latest/delta-storage.html#amazon-s3
On the read part, it should be load and not save:
spark.read.format("delta").load("s3a://<your-s3-bucket>/<path>/<to>/<delta-table>")
Also, I have successfully tested Delta 0.5.0 with on-premise S3 - https://min.io
There were some quirks around the
Use this checklist to track logstash wiki and documentation
- Update https://github.com/Cyb3rWard0g/HELK/wiki/Create-Plugins-Offline-Package
- Update HELK overview picture
- remove alien vault integration
- update with new indexes #256
- document catch all for windows
- document indexme catch all
- some general guideline on X amount of devices and or X amo
I am trying to explain the predictions made by my XGboost model using MMLSparks Lime package for scala. This is my first time using LIME library, I am able to perform a fit operation on the dataset and when I am trying to perform the transform operation, the program stops with an exception, "Caused by: java.lang.ClassCastException: org.apache.spark.ml.linalg.SparseVector cannot be cast to org.apac
Series.reindex
Implement Series.reindex.
https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.Series.reindex.html
Problem
Since Java 8 was introduced there is no need to use Joda as it has been replaced the native Date-Time API.
Solution
Ideally greping and replacing the text should work (mostly)
Additional context
Need to check if de/serializing will still work.
-
Updated
Feb 26, 2020 - R
Improve this page
Add a description, image, and links to the spark topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the spark topic, visit your repo's landing page and select "manage topics."

"Bokeh is a Python interactive visualization library that targets modern web browsers for presentation. Its goal is to provide elegant, concise construction of novel graphics in the style of D3.js, but also deliver this capability with high-performance interactivity over very large or streaming datasets. Bokeh can help anyone who would like to quickly and easi