Nutch build cluster jobs
I need an expert in performance monitoring to ensure our operations are running optimally. I'm currently using Grafana, and now I wish to integrate Prometheus for detailed insights. Key tasks include: - Monitoring our applications and server performance utilizing Prometheus. - Tracking spe...the applications and server. The ideal candidate should have: - Prior experience with Prometheus and Grafana. - Knowledge in performance metrics is crucial. - Ability to work independently and deliver results in a timely manner. This opportunity allows you to display your analytical prowess and contribute to the efficiency of our operations. *Note: My application is running in EKS (Fargate Cluster). As we know the daemon set does not support in Fargate. So if anyone has any alternat...
I am looking for a dotnet core 8 expert with extensive knowledge in AWS hosting to help me host a large cluster capable of handling 100,000 users. Ideal Skills and Experience: - Expertise in dotnet core 8 - Extensive knowledge in AWS hosting - Experience in setting up AWS architecture from scratch - Ability to handle large clusters and manage high user traffic This project is for starting a new startup and I expect it to be completed within a few days. The AWS architecture needs to be set up from scratch. All the work must be attended through anydesk or TeamViewer
...version control. • Constructing automated testing and deployment procedures. Moreover, the individual will be asked to write a terraform script for executing Azure resources. Specifically, it will involve the deployment of a Kubernetes (K8s) cluster, an NGINX homepage and an application gateway. Key requirements include: • Expertise in setting up networking aspects and IP addressing within Azure's environment • Implementing load balancing and traffic routing for smooth user experience • Undertaking basic configuration of elements within the Kubernetes cluster, NGINX homepage, and application gateway. Ideal candidates will have a strong understanding of Azure DevOps, CI/CD pipeline, source code management, version control and automated testing &...
...awesome looking. In his story it is carrying several hundred people to a new planet so massive and utility more than aesthetic. The name "DESTINY" should be displayed on the spine in front of the rings. The attached files shows 3 basic views to give an idea of how he has described it in his little story. The vessel is just under a mile in length with 7 various width rings and a large engine cluster at the back. The rings are connected to the central spire via a series of "spokes" 3, 4, 5 or 6. That has not been defined so it is based on what you feel looks best. I'm looking for a rendered image or images of the ship from a few angles with a star field behind it. Specific requirements: - Create a visually appealing and detailed graphic of a spaces...
I am looking for a freelancer who can help me set up a Mysql Galera cluster on Ubuntu 20.04 and 22.04. The database needs to be configured specifically for a web application. I need this project to be completed within a day. Skills and experience required: - Expertise in Mysql Galera cluster setup - Proficiency in Ubuntu 20.04, 22.04 - Knowledge of configuring databases for web applications - Ability to work quickly and meet tight deadlines and please to be noted there shall be no server credentials provided need to work on remote.
At work we have Swarm and just need some help getting started - can give some screen shots to get a simple container going ? Please note there is a SWARM Cluster at work and we have several application piplines that build a container (gitlab-ci) and have examined serveral of them Do not see where it says a) go to this swarm or b) this is where the container should be building? Any clues? Have a way we can screen share ? There is hope you can give your “best” price; unemployed, and have cancer with bills backing up, $10 possible? Please note $10 is the max total that I can handle for this (doing hourly reduces % fee). Will leave a Glowing paragraph of feedback 5 stars : - ) My funds are low but will pay quick and leave 5 stars. Please give your best poss...
Website organized as a gallery of short videos. Purpose: Showcasing professional work Layout: Masonry layout Ideal Skills and Experience: - Strong knowledge of w...ties: - Home page background is solid black with the exception of logo in upper left-hand corner - The thumbnails for the videos will be video titles - As you scroll over the titles of the videos, the preview plays in full page of background - Clicking on the specific title will open full video page * The attached .png file 'Color Studio' represents the concept for the landing page where the cluster of titles were associated with links to the videos. *The attached .png file 'Color Studio Visual' represents the concept for the video preview to play in landing page background once the user scrolls o...
I am in need of...DBA to help me set up a high availability SQL Server for my existing business. The project involves upgrading my current infrastructure to ensure optimal performance and reliability. Ideal skills and experience for this job include: - Extensive knowledge of SQL Server 2019 and its features - Expertise in setting up high availability solutions such as Always On Availability Groups or Failover Cluster Instances - Experience in database performance tuning and optimization - Ability to assess and upgrade existing infrastructure to meet the requirements of a high availability environment - Strong understanding of disaster recovery strategies and implementation If you have the necessary skills and experience, please submit your proposal outlining your approach to thi...
Deploy a web application on a Kubernetes cluster using Terraform for infrastructure provisioning and Jenkins for continuous integration and continuous deployment (CI/CD). Set up Jenkins on a dedicated server. Integrate Jenkins with the container registry to pull and build container images, .and deploy the application to the Kubernetes cluster automatically after successful builds.
I'm seeking a professional who can expertly build an Azure Kubernetes Service (AKS) cluster using Terraform scripts. This platform will host a low-traffic personal blog website. Key responsibilities include: - Creating an AKS cluster in Microsoft Azure environment. - Ensuring service communication between NGINX ingress and application gateway. - The platform designed should be proficient in handling minimal website traffic smoothly. The ideal candidate will have: - Strong experience with Microsoft Azure. - Proficient knowledge in Terraform scripting. - Demonstrable expertise in AKS and managing low traffic web applications. - Deep understanding of NGINX ingress and application gateway. By taking on this project, you'll expand your portfolio by demonstrat...
Disclaimer : No automated bids I am looking for a developer to help me create a chaos engineering tool that is compatible in injecting chaos with AWS kubernetis , Azure kubernetis and on premises servers . The tool can be used to inject failures in azure kubernetis cluster AKS , amazon kubernetis cluster EKS and on premises application cluster. The chaos types include latency injection, cpu burst, memory exhaustion, killing container , pods , nodes etc . This could potentially be developed in python and should have frontend web-based UI for multiple users to access , although it is not a requirement and I am open to alternative options like Jenkins pipelines . For reference please see a similar tool I do not recommend open source tools chaos mesh
Disclaimer : No automated bids I am looking for a developer to help me create a chaos engineering tool that is compatible in injecting chaos with AWS kubernetis , Azure kubernetis and on premises servers . The tool can be used to inject failures in azure kubernetis cluster AKS , amazon kubernetis cluster EKS and on premises application cluster. The chaos types include latency injection, cpu burst, memory exhaustion, killing container , pods , nodes etc . This could potentially be developed in python and should have frontend web-based UI for multiple users to access , although it is not a requirement and I am open to alternative options like Jenkins pipelines . For reference please see a similar tool I do not recommend open source tools chaos mesh
I have a project where I want to set cluster Preferably with Galera Cluster / Maria DB between 2 vps . The solution should be reliable , at the work should be done in 1 day. A documentation of the architecture will be provided by you .
Model a cluster of oloids to evaluate the volume and shape of the interstices, if any. Obtain cross-sections of the cluster of oloids from various angles to evaluate the geometry of the cross-sections. Animate the effect and forces on the cluster if one or more of the innermost oloids shrinks.
I am looking for a freelancer who can help me install DFTB+ with MAGMA support on a Microsoft Azure compute cluster. This project is for an existing business. Requirements: - Experience with installing DFTB+ with MAGMA support on a Microsoft Azure compute cluster - Knowledge of troubleshooting and providing support for the installation - Familiarity with the software installation process, but may need some guidance Ideal Skills and Experience: - Expertise in configuring and setting up DFTB+ with MAGMA support on a Microsoft Azure compute cluster - Strong troubleshooting skills to resolve any issues that may arise during the installation process - Previous experience in providing support and troubleshooting for software installations I am looking for someone who can ...
I need an approved Facebook app - permission to chat -cluster -comment -login -instegram
Title: Hybrid Kubernetes Cluster - High Availability, Medium Scale We are looking for an experienced professional to help us set up a hybrid Kubernetes cluster with high availability features. The cluster will have a medium scale, consisting of 10-50 nodes. Key Requirements: - Expertise in Kubernetes and container orchestration - Strong understanding of high availability concepts and implementation - Experience in setting up and managing medium-sized Kubernetes clusters - Knowledge of container orchestration features such as auto-scaling and multi-cluster management Preferred Skills: - Familiarity with on-premise deployment and integration with existing infrastructure - Proficiency in configuring and optimizing Kubernetes clusters for performance and securit...
...Prometheus, Go, with a recommendation to know Helm and Web3, would look like this: ### Senior SRE/DevOps Engineer Requirements **Essential Qualifications:** 1. **Terraform Proficiency:** Strong experience in using Terraform for infrastructure as code, including module development and state management. 2. **Expertise in Kubernetes:** Advanced knowledge in Kubernetes for container orchestration, cluster management, scaling, and network policy implementation. 3. **AWS EKS Skills:** Proficient in deploying and managing Kubernetes clusters using AWS Elastic Kubernetes Service (EKS). 4. **Monitoring and Alerting Tools:** Skilled in setting up and using Grafana and Prometheus for system monitoring, performance tracking, and alerting. 5. **Programming in Go:** Solid experience in Go pr...
Moodlebox on a cluster of up to 3 Raspberry Pi 4B+ 4GB or 8GB boards with the purpose being to increase the number of simultaneous users that can connect to the Moodlebox (Cluster), and to improve the speed at which content is streamed to connected devices. Desired outcomes: The Moodlebox cluster must: 1. be able to handle at least 75 simultaneous connections with video being streamed on up to 40 of those connections. 2. be customisable. All customisations that are possible on the regular Moodle installation must be possible on the Moodlebox cluster. 3. be able to have a wi-fi antenna connected to it to increase the range that the wi-fi signal from the Moodlebox is broadcast. The selected consultant will design the setup and guide someone remotely to setup an...
I am looking for a skilled developer to help me make multiple VS code containers running on an EKS cluster available on a browser on https. Make multiple VS code containers running on EKS cluster available on browser (https) exposed via AWS loadbalancer - Deploy VS code container () on EKS cluster - EKS cluster is exposed via AWS load balancer - the VS code container can be accessed on browser (https) - multiple unique instance of VS code should be available so that different user can access different containers at the same time The end goal is for multiple users to be able to code in browser VS code simultaneously, separate container for each user Please provide a proposal outlining your experience and approach to this project.
I am looking for a Node.js expert who can implement the Cluster mode in my existing code to ensure high availability and fault tolerance. The ideal candidate should have 8-10 years of experience in Node.js and be familiar with Cluster mode. Requirements: - Improve performance and scalability by managing multiple processes in the Cluster mode. - Enable cluster mode with multi-file authentication Skills and Experience: - Strong proficiency in Node.js. - Experience with Cluster mode and its benefits. - Knowledge of fault tolerance and high availability strategies. - Ability to adapt and modify existing code. - Excellent problem-solving and debugging skills. If you have the necessary skills and experience, please bid on this project. I am looking for a d...
Project Description: I am seeking a skilled freelancer proficient in 3D modeling, specifically in Blender, to create a low-poly object for use in Second Life. This object should resemble a cluster of crystals emerging from a stone. Technical Requirements: 1. Low Poly Count: The object should have a minimal impact on performance, not exceeding 2 prims (primitives) in Second Life. 2. Simple Texturing: Simple textures are required to enhance the appearance of both the crystals and the stone. 3. Second Life Compatibility: The final file must be exported in a format compatible with Second Life (COLLADA or other suitable format). 4. Aesthetic Details: The design should be visually appealing, realistically representing crystals emerging from a stone. Expected Deliverables: 1. Blen...
I am looking for a PCB designer with advanced level skills to create a single board computer similar in looks as the raspberry pi compute module 3 ,with the ram interchangeable. Skills and Experience Needed: - Advanced level PCB design skills - Experience in designing single board computers - Familiarity with cluster computing concepts - Ability to provide guidance on component selection
I am looking for a freelancer who can assist me with setting up EKS and integrating Hashicorp Vault on the EKS setup via Crossplane. Requirements: - Experience with setting up EKS and integrating Hashicorp Vault - Knowledge of Crossplane - Ability to guide and assist in setting up EKS for a beginner in Crossplane Specifically, configure the following: A Vault server (in the same cluster) A Crossplane installation with AWS provider on EKS Provision a S3 bucket through Crossplane. Publish bucket information as a Vault secret. Access the published information in Vault from a pod using Vault Agent Injector Skills needed: - Experience with EKS setup - Familiarity with Hashicorp Vault - Knowledge of Crossplane at a intermediate or expert level
I am looking for a skilled developer who can help create a chaos engineering resilency tool using Python. The tool can be used to inject outages in azure kubernetis cluster AKS , and on premises legacy application cluster. The chaos can be latency injection, cpu burst, memory exhaustion, killing container , pods , nodes etc . This could potentially be a web-based application, although it is not a requirement and I am open to alternative options like Jenkins pipelines, desktop applications etc . I don’t want to use open source like gremlin , chaos mesh etc For reference please see a similar tool Note: No automatic bids and when you bid for this please highlight any similar project examples
...servers on Nutanix. The project involves updating the IP address of the host, hypervisor, CVM, Prism Element/Prism Cluster for each server. Requirements: - Experience with Nutanix and server administration - Knowledge of networking and IP address configuration - Ability to update IP addresses on multiple servers - Familiarity with host, hypervisor, CVM, Prism Element/Prism Cluster configuration The project will require the following tasks to be completed: 1. Update the IP address of the host for each server 2. Update the IP address of the hypervisor for each server 3. Update the IP address of the CVM for each server 4. Update the IP address of the Prism Element/Prism Cluster for each server The current IP addresses will be provided, and I have the new IP address...
I have an existing K8s setup for Google Cloud which contains ingresses for the api, webapp and website. I need a similar setup for a Sandbox environment. I already created a GC Sandbox cluster and all the containers are up and running, and all the Sandbox databases and secrets have also been defined. I need ingresses for the following: (not needed for website) I guess a Google managed certificate might be required. I can't remember how we did it for the Production environment last time. I will provide the ingress sample upon request and add you as an admin to GC via IAMs.
We need to set up a POC on AWS using EKS (managed nodes). We need someone to document the steps to set up in AWS and support us to get it running. We need these items documented so we can replicate them. 1. Build a docker image for a Java Spring Boot application (Which we will supply). This will be very simple. It will return a message when a GET is received. This is Service A The same applies to a different Spring Boot application (supplied). This will return a different message. This is Service B 2. Upload image to ECR. Document any steps in setting up ECR 3. Create a cluster in EKS. 4. Create a persistent volume. 5. Service A and Service B should also mount the PV so we can store local files if we need to 6. Create another service running MySQL (or postgres), stori...
Busco un experto que me ayude a configurar y estabilizar mi cluster local usando Proxmox, Ceph y Kubernetes nativo. Estado actual del clúster local: Aún no configurado Habilidades y experiencia ideales: - Familiaridad a nivel de experto con Proxmox, Ceph y Kubernetes nativos. - Conocimiento profundo de la infraestructura y el software de clúster - Experiencia en la instalación y configuración de clústeres utilizando Proxmox, Ceph y Kubernetes nativos. - Español nivel nativo Plazo previsto: 1-3 meses Si tiene los conocimientos y la experiencia necesarios para trabajar con Proxmox, Ceph y Kubernetes nativo, y puede comprometerse a completar este proyecto dentro del plazo establecido, póngase en contacto conmigo.
Project Title: Create Helm Chart to deploy Redis Cluster Project Description: Create a Helm chart from Scratch to deploy Redis We should be able to deploy a clustered Redis The cluster size can be from 1 node to 10+ nodes Data in Redis should Replicated and persisted. Make use of dynamic volume provisioning on AWS. Please test to make sure that Redis Cluster has formed.
I am looking for a *Spanish speaking* freelancer with intermediate expertise in DevOps, Kubernetes, and Linux to assist me with setting up a Kubernetes cluster. The specific tasks for this project include: - Setting up a Kubernetes cluster - Managing containerized applications - Troubleshooting and debugging any issues that may arise -Knowledge Gitlab and Terraform We require the migration of certain Postfix servers from on-premises infrastructure to the IBM Cloud platform. The ideal candidate should have intermediate level expertise in DevOps, Kubernetes, and Linux. They should be able to work independently and have experience with setting up Kubernetes clusters. Spanish is required. This project has an immediate timeline, and I expect the freelancer to co...
Experience in designing, implementing, and managing large-scale infrastructure projects. Expertise in setting up and configuring OpenShift clusters on bare-metal servers. Strong knowledge of networking requirements for high-performance, low-latency communication. Experience in designing an...projects. Expertise in setting up and configuring OpenShift clusters on bare-metal servers. Strong knowledge of networking requirements for high-performance, low-latency communication. Experience in designing and optimizing Spark clusters, including auto-scaling mechanisms. Proficiency in setting up and configuring MinIO for high scalability and data ingestion. In-depth knowledge of Elasticsearch cluster design, optimization, and security. Strong scripting and automation skills (e.g., Ansible, T...
I am looking for a freelancer who can assist with advanced level tasks in deploying and configuring Kubernetes and Istio. The ideal candidate should have experience in working with Amazon Elastic Kubernetes Service (EKS). Specifically, I need help with the following tasks: - Deployment and configuration of Kubernetes and Istio - Monitoring and scaling of the Kubernetes cluster - Troubleshooting and debugging any issues that may arise during the deployment process The freelancer should have a deep understanding of Kubernetes and Istio, as well as experience in working with advanced level projects. They should also be familiar with Amazon Elastic Kubernetes Service (EKS) and have a good understanding of its deployment environment. If you have the necessary skills and experience, ...
AKS Architecture I am in need of an architecture diagram for a Windows environment, specifically for an AKS cluster setup. The project requires a basic AKS cluster setup with specific integrations and customizations. Specific requirements and preferences: - Windows environment - Basic AKS cluster setup - Specific integrations and customizations Timeline: - Immediate (within 1 week) Ideal skills and experience: - Experience with AKS architecture design - Proficiency in Windows environment - Knowledge of scaling and load balancing for AKS clusters - Ability to integrate and customize AKS clusters in a Windows environment
I am looking for someone to help me with some minor modifications to a picture. The ideal candidate wo...flexible with the deadline, but its a small job it would not take more than 3 hours There is 1 image that need to be edited. things should be done: - Swap the RPM to the right and the Speed to the left (in the attached photo the speed is on left and RPM is on the right) - Maximum RPM is 8 i want it to be 7 - Maximum speed is 280 i want it to be 220 - Change the word in the speed cluster from MPH to km/h - Speed cluster should start from 20 to 220 ( look at speed example ) - Remove the red needle from the RPM gauge and the Speed Gauge (i attached an example picture for how i want it) If you have the skills and experience necessary for this project, please submit your pro...
I am looking for a skilled developer who can help create a chaos engineering resilency tool using Python. The tool can be used to inject outages in azure kubernetis cluster AKS , and on premises legacy application cluster. The chaos can be latency injection, cpu burst, memory exhaustion, killing container , pods , nodes etc . This could potentially be a web-based application, although it is not a requirement and I am open to alternative options like Jenkins pipelines . For reference please see a similar tool
I am looking for a freelancer to enhance the performance of my Proxmox cluster on Hetzner (don't panic but it is a piece of crazy art cluster). Currently, I am experiencing slow virtual machine performance, and that is not the problem. the real problem is: that the internet is very very slow on the VMS. Specifications: - My existing Proxmox cluster has mid-range specifications. Workload: - My Proxmox cluster primarily handles web server workloads mainly Cpanels. Ideal Skills and Experience: - Extensive experience in optimizing Proxmox clusters and resolving internet performance issues. - Strong knowledge of virtualization technologies and Proxmox. - Expertise in troubleshooting and optimizing virtual machine performance. - Familiarity with Hetzner infr...
I need for a devops with good knowledge of kubernetes to deploy a demo application on a small 3 nodes cluster, using my production docker-compose file as source to know about services and ports. The compose stack is actually made of 7 containers (3 apps, 3 db, 1 search engine) and 5 volumes.
Description: Create a Hardware-Software Codesign version of the k-mean clustering algorithm K-means clustering is a popular data mining algorithm that partitions n samples into k clusters (note: the k-nearest neighbor classifier algorithm used in machine learning can leverage the cluster centers produced by the k-means clustering algorithm). The problem is in general NP-hard but heuristic algorithms have been developed that quickly converge to a local optimum solution. We will consider one of those algorithms in this project. I have provided a C code version of the k-means clustering algorithm, and a Vivado block diagram and memory layout (explained below) that you will use as a starting point. You will need to study the C version and then decide which components to implement as a V...
I am looking for help on setup AWS service mesh and troubleshooting. I have an fargate EKS cluster running few services . i have created aws service mesh created with terraform and trying to install sidecar injection mechanism. unable to successfully configure sidecar injection of app mesh. Need help to troubleshoot 1. sidecar injection controller troubleshoot 2. Securing communication between microservices is critical to protect sensitive data and prevent unauthorized access
I have a Custom K8s installed. On top of it, I am trying to install free5gc - But everytime I install free5gc, I get error about CNI. I believe there is some issue with K8s networking. I need someone who is expert in K8s networking and help me to resolve my issue. I will not provide any access. I will share my screen over zoom. Kubernetes expert needed for troubleshooting and debugging tasks in my custom K8s Cluster. The ideal candidate should have experience in cluster setup and configuration, as well as application deployment and management. Immediate assistance is required, with a deadline of within 1 week. Experience with AWS, Google Cloud, or Microsoft Azure would be beneficial.
I am looking for...with experience in AKS design and administration. The primary goal of this project is to deploy and manage containerized applications in a scalable and highly available AKS cluster. Skills and Experience: - Strong knowledge and experience in AKS administration and engineering - Expertise in certificate management and configuring AKS clusters for high availability - Familiarity with using Application Gateway for containers - Proven track record in optimizing AKS performance and cost efficiency - AKS cluster creation through azure biceps, - Integrating AKS with azure devops The client already has an existing AKS cluster, so the freelancer will need to work with the existing setup. The level of access for the freelancer will be determined based on th...
...someone to install a cluster on our system as we need specific hardware and software requirements met. We have already determined the type of cluster that we need – an AKS cluster – and have specific requirements for the hardware and software. However, we are still in the process of gathering complete details and information and will send that information over later. Therefore, we need an individual to install the cluster for us according to our specific requirements and ensuring that the cluster is working optimally. The individual that we are looking for must have a great deal of experience with system engineering and have a strong knowledge of software architecture. Finalizing the project would require a few testing sessions to make sure...
I am looking for a freelancer who can help me set up replication and configure general settings in Proxmox VE. Replication Setup: - I am specifically looking for a two-way replication setup. Server Setup: - We have two servers running in a cluster, we need to replicate a Plesk instance between the two servers. Our endgoal is to have a working failover for Plesk and Proxmox Preferred Communication: - I prefer to communicate via instant messaging throughout the project. Ideal Skills and Experience: - Proxmox VE expertise - Experience in setting up replication - Strong knowledge of general server configuration - Proficiency in instant messaging communication.
I need to build a Geode cache system (key value pair) with the following requirements: 1. Two locators, each locator is connected to two servers. 2. When an update or insert operation is done on a cluster, the other cluster should be notified and the data should be updated in the notified cluster. 3. Include a configuration file to deploy the clusters locally and on AWS. Please don't use gfish command, I need the cache to be deployable easily to cloud and locally. 4. Include a readMe file on how to deploy the clusters locally and to AWS. 5. Use the latest Geode version. Note: this is a fixed price project, not hourly rate. Apache Geode experience is required to apply to this tiny project.
... Web Server (Server 1): Install and configure vBulletin on the web server. Ensure proper synchronization of vBulletin files across the server cluster. Database Server (Server 2): Set up and configure MySQL or another database server. Create and configure a database for vBulletin. Establish secure communication between the web server and the database server. Image Server (Server 3): Configure the image server to serve static files, including vBulletin images. Update vBulletin configuration to use the image server for serving images. File System Setup: Implement a reliable file synchronization method across the web server cluster. Load Balancing (Optional): Implement load balancing to distribute incoming requests across multiple web servers. Security...
We have a dataset of people commuting between location along with other attributes like rental prices etc. We would like a sophesticated network analysis to cluster towns which are similar based on attributes and commute patterns (perhaps to common destination) to identify meaningful groupings. The results need to be justified with explanations of chosen mechanism (analysis, algorithms etc.) and some graphs to give an intuitive sense of the groupings on a map. Assume the data is complete and free from errors. Please include response to the following questions in your proposal to be considered : 1. Can you give a brief example of a similar kind of project that you may have done in the past ? 2. How would you think about centrality in this dataset which is both directed (town a - tow...
Years of experience: 7+ Location: Remote - India Contract Tenure - 03-06 Months Notice Period - Immediate -15/20 Days Timings : 12pm - 9pm IST M - F AWS Data Engineer Requirements • Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines. • Connect with stakeholders...Cloud Watch, Service Catalog and IAM Roles • Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes. • Should have good knowledge about Tableau, with creating Tableau Published Datasets and managing access. • Write PySpark scripts to process data and perform transformations.(Good to have) • Run Spark jobs on AWS EMR cluster using Airflow DAGs.(Good to have)...
Requirements: App 1: - A spring boot app that will receive only one rest request with 2 request parameters an and b. - That request will insert a record into the db with that two values. And also send a request to the current k8s cluster that will start a job with some predefined deployment definition. App 2: - This is the application which will execute the actual job. The job is to read a db table and print in the log. Deliverables: - App 1 and 2 codebase in two different project structure.
