If you want to know how to get a JupyterHub environment, you should go to the JupyterHub Docker tutorial. Users will have the power of JupterLab in a shared environment. To add new users to the JupyterHub environment you have to follow these steps. Step 1: Going to Hub Control Panel As the admin user, go to…

JupyterHub allows using the power of notebooks to groups of users. You will be able to create containers with JupyterHub and libraries such as Pandas, Scipy, matplotlib, and Dask for multi-users through a central server. JupyterHub Docker is an image to create an environment with a JupyterHub Server to share…

This is a tutorial to get a Kafka environment using Docker. You can dive and check details in the git repository here. Cloning git repository $ git clone https://github.com/rancavil/kafka.git $ cd kafka Building the image We are using Kafka version 3.0.0. $ docker build -t kafka:3.0.0 . Creating the container We are going to create a container with Kafka. …

I like Python because it is a flexible and extensible programming language. I wrote this little and short article to remind myself of the advantages and power of Python. How you know, we can’t subtract elements of two lists. We’ll get an error. >>> [1,2,3] - [1,2,3] Traceback (most recent call…

We are going to deploy a pyspark environment using Docker built from scratch. Update: Click here if you want to use a pyspark and jupyterlab version. Creating a Spark Image First of all, we’ll create an image from scratch. We are going to use Spark 3.2.0. $ git clone https://github.com/rancavil/pyspark.git $ cd pyspark $ docker build…

We are going to execute an example of MapReduce using Python. This is the typical words count example. First of all, we need a Hadoop environment. You can get one, you can follow the steps described in Hadoop Single Node Cluster on Docker. …

This tutorial will show to get a Hadoop Single Node Cluster using Docker, we are going to from docker image building to run a container with an environment with Hadoop 3.3.0 configured as a single node cluster. Creating the Hadoop image $ git clone https://github.com/rancavil/hadoop-single-node-cluster.git $ cd hadoop-single-node-cluster $ docker build -t hadoop . To run and create a container execute the next command:

This is a little example of how to develop a C extension module for Python. Python provides the possibility to extend its power developing code in C. The example shows a simple maths module (called simplemaths), with methods: add, subtract, multiplicate and divide two integer numbers. All functions are developed…

It is a library for symmetrical remote procedures call and distributed computing. The library allows us to use remote objects as local objects. Here a little example. Installing RPyC It’s easy, just use pip to install the library. # sudo pip3 install rpyc The server code We are going to develop a math service that…