Filter

My recent searches
Filter by:
Budget
to
to
to
Type
Skills
Languages
    Job State
    2,000 etl unix jobs found, pricing in USD

    I wrote a Java program that I want to sell to users. I want to make sure that no one can reverse-engineer the...that no one can reverse-engineer the byte codes to recover my source code. I am aware of the concept of obfuscation, but I have no experience with specific obfuscators. I'm looking for someone with experience using obfuscators. I want you to: 1) Recommend an obfuscator. 2) Explain why you recommend that obfuscator and no other. 3) Show me how to download and install that obfuscator. 4) Create a UNIX shell script which applies that obfuscator to my Java program. This is a fixed price contract. The total value is $250.00 USD, which will be paid upon successful completion of the steps above. Please do not apply for this project unless you have already done this at lea...

    $113 (Avg Bid)
    $113 Avg Bid
    30 bids

    Objective: Upgrade an existing ETL process to enhance data validation, error handling, and user feedback for structured Excel files uploaded to SharePoint 2019, for subsequent transfer to a database. The solution could be also implemented via Azure Functions and Sharepoint online if deemed possible. Existing Setup: A basic ETL process developed with the Luigi library, lacking advanced validation and user feedback mechanisms. Solution uses parsing code (Pandas) for Excel files data parsing that can be utilized for the upgrade also. There are 4 different excel files, so 4 different parsers will be provided. The system should manage four unique Excel file types, each in its own SharePoint folder, requiring separate parsers for their distinct structures. An initial selection...

    $1515 (Avg Bid)
    $1515 Avg Bid
    21 bids

    Looking for an experienced MSBI and powerbi developer. You would be working with me to troubleshoot and optimize an existing MSBI solution and powerbi report. Your tasks include but are not limited to: - Data Modeling - ETL Development - Report Development For this project, your primary tools would be: - SQL Server Integration Services (SSIS) - SQL Server Analysis Services (SSAS) - power bi Your experience and skills in these areas will be critical to the success of our project. Only serious and high-quality professionals need apply. This is a challenging role and previous experience in the given areas is a must. Let's enhance our MSBI solution together and make it the best it can be.

    $147 (Avg Bid)
    $147 Avg Bid
    2 bids

    1) Continue on previous projecName existing api to: api/v1/log/post 12 New api: api/v1/log/get-time/<Serial> • For instance, api/v1/log/get-time/12344 • Returns unix time from Redis, 0 if not exist 3) Add customizable numeric return value for API functions • , return OK codes for all calls – api-user must decode different numeric values. 4) Change inserts to use COPY 5) Change to unix time in post message 6) Add redis data cache. • Lookup serial number in redis, if exist then process post-message • Add unix time from the first line as value to the serial key 7) Restructure user/database, something like this (a log_user shall only be allowed to INSERT/COPY into log_data in Postgres:

    $300 (Avg Bid)
    $300 Avg Bid
    1 bids

    ...manage and organize data within it. - Ability to ensure data security and integrity throughout the extraction and integration process. **Ideal Skills and Experience:** - Proven track record of working with POS systems, especially Clover, for sales data extraction. - Strong background in cloud-computing platforms, specifically Azure. - Comfortable with setting up and managing data pipelines and ETL processes. - Experience in setting up automated workflows between different technological platforms. - Knowledge of data visualization and interpretation, to guide the final format of sales data within Snowflake. This project requires a freelancer who can swiftly understand our data infrastructure and implement a solution that minimizes manual intervention and maximizes data utility f...

    $514 (Avg Bid)
    $514 Avg Bid
    26 bids

    ...guidance especially in the area of ETL processes. I need to focus on: - This is an interview support role, You are supposed to help in live interviews. • Extraction techniques – The primary data sources of my interest are platforms like Spark, AWS, Azure, GCP, and Hive. I want to understand effective methods for data extraction from these particular sources. Ideal Skills and Experience: - Expertise in ETL tools for data extraction - Hands-on experience with Spark, AWS, Azure, GCP, Hive - Profound knowledge in data engineering - Experience in career coaching or mentoring will be a bonus - SQL -Python This assistance will give me a competitive edge in my upcoming interviews by providing me with practical skills, knowledge, and confidence in addressing ETL...

    $10 / hr (Avg Bid)
    $10 / hr Avg Bid
    2 bids

    I'm seeking an experienced Data Engineer with proficiency in SQL and PySpark. Key Responsibilities: - Develop and optimize our ETL processes. - Enhance our data pipeline for smoother operations. The ideal candidate should deliver efficient extraction, transformation, and loading of data, which is critical to our project's success. Skills and Experience: - Proficient in SQL and PySpark - Proven experience in ETL process development - Previous experience in data pipeline optimization Your expertise will significantly improve our data management systems, and your ability to deliver effectively and promptly will be highly appreciated.

    $92 (Avg Bid)
    $92 Avg Bid
    14 bids

    I am urgently requiring the development of an incremental ETL pipeline. To do this job successfully, you will need to provide two main deliverable: -Architecture diagram: Demonstrates your plan for the ETL pipeline structure. -ERD diagram: A depiction of entities, their relationships, and the data flow. Ideal Skills and Experiences: -Broad experience in ETL, particularly incremental ETL pipelines. -Proficiency in creating architecture and ERD diagrams, showcasing complex data flows. - Familiarity with a variety of technologies for implementing ETL process. While we skipped the preference, a broad knowledge base will be advantageous. I am in a hurry for this project, therefore your ability to work efficiently and effectively within a tight schedule ...

    $93 (Avg Bid)
    $93 Avg Bid
    5 bids

    More details: Which specific programs do you want to install and run using Cygwin? Program A What functionality are you ex...type of files will you be running through Program A in Cygwin? py, Mol2, dms The programmer should get access to my laptop and manage to install cygwin correctly, because I failed and bashrc file was not in Home directory - actually, I could not even find it anywhere. And, I think that its environment should be at home/usrname where unix normally is. But it was in my windows env under users/me. Meaning I had a GUI (Windows) for my files. Which I should not (Unix). So, overall wrong. So, even if I installed programs I could not run anything. I am not requesting you to run my files. I want you to set the program for me to do my jobs. I hope that is...

    $21 (Avg Bid)
    $21 Avg Bid
    3 bids

    Looking for a seasoned AWS expert to assist in optimizing EC2 instances, S3 storage, and Lambda functions for improved performance. The ideal candidate will have: Mainly working on Aws glue jobs , S3,lambda, Crawler, step functions, dynamo DB ,Clouldwatchs, Appflow, parameter store , API Gateways, ETL Jobs,splunk logs CloudFormation - important big bucket,Spunk, Jenkins pipelines* CI/CD * , YAML for creating templates and manifest files * Sql mandatory for date base * ⁠using Postman for API calls * ⁠Python and spark Musk know

    $12 / hr (Avg Bid)
    $12 / hr Avg Bid
    12 bids

    ...integrity throughout the data lifecycle. - Implement monitoring and alerting systems to proactively identify and address issues. - Stay up-to-date with emerging technologies and best practices in data engineering. *Requirements:* - Bachelor's degree in Computer Science, Engineering, or a related field. - Proven experience as a data engineer or similar role, with a strong understanding of data modeling, ETL processes, and database technologies. - Proficiency in at least one programming language commonly used in data engineering (e.g., Python, Java, Scala). - Hands-on experience with cloud platforms (e.g., AWS, Google Cloud, Azure) and related services (e.g., S3, GCP BigQuery, Azure Data Lake). - Familiarity with containerization and orchestration tools such as Docker and Kub...

    $84 (Avg Bid)
    $84 Avg Bid
    3 bids

    I'...of data from spreadsheets. The end goal is to improve the data accuracy. Your Key Responsibilities: - Understand the current data structure in the spreadsheet - Merge information from various sections accurately - Ensure no data is lost or inaccurately merged during the integration process Required Skills and Experience: - Extensive experience with data extraction, transformation, and loading (ETL) tools - Proficient in data integration methodologies - Expert in handling spreadsheets and large sets of data - Proven track record of improving data accuracy When submitting your application, please include your experience in handling similar projects. Your ability to demonstrate a clear understanding of this project and its requirements will be a key factor in my decision-...

    $11 / hr (Avg Bid)
    $11 / hr Avg Bid
    35 bids

    I'm in need of immediate assistance for developing a file management library coded in C, fully compatible with Linux. Project Presentation The project aims to implement a library of file management functions simulating those of UNIX. After formatting a "partition" (a large classic UNIX file), the functions should allow for file creation, reading/writing, information retrieval within a file, and file destruction. Work to be Provided The library to be built should contain at least a file type and the following functions: int myFormat(char* partitionName); the function returns 0 if the "formatting" succeeds. • file * myOpen(char* fileName); the function "opens" or creates a file with the given name. • int myWrite(file* f, void* b...

    $39 (Avg Bid)
    $39 Avg Bid
    8 bids

    Seeking an experienced Raspberry Pi programmer with a knack for both the back end and front end development. Your task will be to develop and design a user-friendly GUI that will display real-time data from light sensors and cameras. This project will require: - Proficiency in Python Langugage and Unix/Linux environment - Effective translation of sensor data onto GUI designs - Experience working with various light sensors and cameras, - Demonstrated ability to design visually appealing interfaces while maintaining practical functionality. This role is ideal for someone with a deep understanding of Raspberry Pi's capabilities, adept at displaying real-time sensor readings. A good eye for design is key, as is experience creating remote-accessible interfaces. Let's bring t...

    $116 (Avg Bid)
    $116 Avg Bid
    6 bids

    **OVERVIEW:** Seeking a Deployment Aut...the database and the other for the system and its dependencies) 2 - Then dockerize each of the 06 components **REQUIRED TECHNICAL SKILLS:** -Proficient in Bash scripting, Python, and Go. -Strong background in Docker for containerization and high-availability setups. -Experienced in PostgreSQL database setup and management. -Skilled in SSL certificate setup with Let's Encrypt. -Familiar with Linux/Unix systems, network configuration, and security practices. **USEFUL LINKS** Here is the solution: We expect you to provide the link of the solution installed on your server with access credentials to test the solution as proof of completion before we can award you the prize and request the bash script and docker files.

    $1000 (Avg Bid)
    $1000
    13 entries

    ...multi-node EBS environment to administer Concurrent Managers, Concurrent Programs, Request Sets, Request Groups, Workflows and troubleshooting Workflow Mailer/Notification issues. • Expert-level knowledge of Oracle 19c/12c database administration, maintenance, security implementation, upgrade and patching, database performance tuning, sizing and capacity planning, database backup and recovery in a Unix O/S using RMAN and Oracle export/import utilities, administration, and maintenance to provide backup and disaster recovery. • Knowledge of installation, configuration, and maintenance of multi-node Oracle RAC enabled databases, including Oracle ASM and Oracle CRS management. Knowledge of PL/SQL packages, shell, and Perl scripts for task automation, and proactive database ...

    $2622 (Avg Bid)
    $2622 Avg Bid
    4 bids

    ...and maintaining Oracle databases to support our organization's applications and business processes. This role requires proficiency in SQL, PL/SQL, database functions, triggers, ETL processes, and database performance tuning. Key Responsibilities: • Design, develop, and implement Oracle databases to meet business requirements. • Perform database administration tasks, including installation, configuration, backup and recovery, and monitoring. • Write efficient SQL and PL/SQL code to support application development, including the creation of functions, stored procedures, triggers, and packages. • Develop and maintain ETL processes to extract, transform, and load data from various sources into Oracle databases. • Optimize database performance t...

    $12 / hr (Avg Bid)
    $12 / hr Avg Bid
    19 bids

    ...Malaysian freelancer) to play a pivotal role in our dynamic team. In addition to the responsibilities mentioned earlier, the successful candidate will be entrusted with deploying Talend solutions in both testing and production environments. If you possess hands-on experience in deploying ETL solutions and ensuring their seamless operation in varied environments, we encourage you to apply. Responsibilities:- Talend Job Design: Develop efficient and scalable Talend job designs for various data integration and ETL processes. Implement best practices for job design to ensure maintainability, reusability, and performance. Version Control: Implement version control for Talend jobs to manage changes, updates, and rollbacks effectively. Ensure proper documentation of changes ma...

    $631 (Avg Bid)
    $631 Avg Bid
    13 bids

    ...6-8+ years of relevant experience Proficient understanding of algorithms, data structures, architectural design patterns and best practices. Solid proficiency in PHP and Laravel 6-8 years of experience with PHP Knowledge of modern authorization mechanisms, such as JSON Web Token Strong problem-solving and analytical skills. Required Skills Advanced PHP and MySQL knowledge version control (git) unix commands Strong understanding of the MVC pattern, OOP Laravel Repository Pattern Experience in Unit testing (PHPUnit) Experience building, optimizing, and utilizing REST APIs Extensive knowledge of coding standards and best practices Experience with such code versioning tools as GIT Agile work experience Full software life-cycle experience working on complex products within Agile en...

    $183 (Avg Bid)
    $183 Avg Bid
    55 bids

    ...looking for a skilled Python ETL expert to assist us with a data transformation project. Our goal is to extract, transform, and load data from various sources into a structured format for analysis. We need someone with experience in automating ETL pipelines, handling data quality issues, and ensuring seamless integration. Key Responsibilities: Retrieve data from all sorts of places – databases, APIs, and flat files. Work on raw data, making it clean, consistent, and accurate. Handle missing values, normalize data, and some feature engineering. Load the transformed data where it belongs, ensuring it gets along with our storage solution. Test and validate, ensuring our data stays true to its transformed self. Proven experience in Python development with a focus on ...

    $51 (Avg Bid)
    $51 Avg Bid
    20 bids

    I need an expert well-versed in Python or Access macro to...Your solution should be capable of aggregating the data where necessary. - Category-wise CSV Export: Export the resulting data into .csv files, with one file per category of data. The ideal freelancer for this project should have the following skills: - An excellent understanding of Python or Macro Access programming. - Proven experience working with data extraction, transformation and loading (ETL). - Familiarity with data aggregation and analytical operations. - A good understanding of CSV files and how to manipulate them in Python or Access. - Past work with data-based projects is a bonus. The effectiveness of your solution in addressing these tasks will be a key determinant of its success. Looking forward to working...

    $154 (Avg Bid)
    Urgent
    $154 Avg Bid
    19 bids

    ...of the source data, we process the data, create analyses and credit ratings Where we are now: - We have Crawlers that create datasets from 2020. (Several terabytes of data for 4.5 million profiles of Polish companies) - we have a product design (report structure) What we need: - that in order to proceed with IT development, we need to develop a Data Ddocumentation that would describe (Crawlers, etl and rating model) My proposal for the first task is: - source data analysis - to design a documentation structure that would enable IT development, testing and maintenance of the databases, something else ? P.S. A demonstration of initiative for the proposed activities is welcome. If you have experience in documenting 100% of the data flow then you can suggest additional steps/tas...

    $20 (Avg Bid)
    $20 Avg Bid
    1 bids

    ...preferred. - 6 + years of software engineering and development, including 2 years in technical leadership. - Significant experience as a full stack developer. - B2 level English. - Must be well versed with C#, .NET, Angular(Or React), SQL Server and Azure DevOps. - Significant experience in new computing architectures and implementation of networked computing structures. - Experience developing NT, Unix, and/or Windows based applications, strong component, process and data modeling skills. **Preferred Skills** - Azure DevOps and/or Native Cloud Services - Agile/Scrum - C#, .NET, SQL Server, or Angular or React certifications **Compensation Pay Disclosure** Top Talented is committed to pay that’s fair and equitable, which means comparable pay for comparable roles and res...

    $12871 (Avg Bid)
    $12871 Avg Bid
    66 bids

    I'm looking for a skilled developer to assist with a Google Earth project, focusing on user interface design. Main Tasks: - Designing the user interface Features Required: I would like a Google Maps web based application. Where the users are able to click features on a map using terrene view(for example trees) JavaScript to pick up the location and addre...features on a map using terrene view(for example trees) JavaScript to pick up the location and address of the property that’s been selected, and the address to be saved into a database using perl CGI in my SQL database. The perl component is optional. Areas that have previously been selected should be highlighted in a yellow highlight or similar The code should work on windows and a Unix platform. I will provide a ...

    $135 (Avg Bid)
    $135 Avg Bid
    28 bids

    ...need professionals with an extensive understanding of data extraction, transformation, and integration in the banking domain. Your overarching role will encompass integrating our banking system with a new data warehouse. NOTE: The team or company must have relevant experience in the BANKING DOMAIN. Note: Looking for a full-time available team. Key Responsibilities: - Apply your expertise in ETL tools to extract, transform, and organize multiple data streams. - You will integrate the cleaned data with other various parts of our banking systems. Analytical Requirement: - Your role will also demand you to leverage your solid background in developing insightful reports in the banking context. While not mandatory, the ability to pull in data from customer’s transaction...

    $22 / hr (Avg Bid)
    $22 / hr Avg Bid
    17 bids

    ...processing of data, utilizing web scraping technology, APIs, and python libraries like beautiful soup for processing. For this project, the main tasks include: - Designing and implementing effective scraping systems to collect and process data - Integrating to our current system Skills and Experience Ideal candidates for this project should have: - Proven experience in data engineering, API, ETL, and scraping projects. - Proficiency in Python Libraries such as BeautifulSoup or Scrapy. - Demonstrable past work related to data science or data engineering Here are some additional details to help you understand the specific project requirements: Background on What My Clients Need | Information to Help Salespeople: I help sales teams perform better by providing them informatio...

    $21 / hr (Avg Bid)
    $21 / hr Avg Bid
    68 bids

    ...AlmaLinux 8.x but on AlmaLinux 9.x instead. is the files that I use copied from AlmaLinux 8. is an example screenshot of how my current theme look like. # (part 2) A part 2 of this would be figure out a catchy name for my new XFCE theme that would make people to install and use this theme. To get this theme included in so many Linux/Unix dist as possible. Spread and uploaded to many XFCE/(if possible gtk3) theme sites. Simply to do marketing for my theme. The person doing part 2 doesnt have to be same as doing part 1. Its actually different skills that are needed in part 1 and part 2. My working name for this theme is "XFCE Petrol Theme" but that can be changed if there is a better suggestion. My request here at freelancer

    $546 (Avg Bid)
    $546 Avg Bid
    6 bids

    ... - there are various historical data as formatted csv. I want import Historical Trades to PostgreSQL database, Daily spot and USDM CSV files can be downloaded. I want Vue.JS front end page for upload these downloaded csv files. Backend should be asp.net Core Web api. Sample CSV File Columns: id trade ID price Price qty Quantity base_qty Base Quantity time Time in unix time format is_buyer_maker Was the buyer the maker Desired App Features: - PostgreSQL Database Connection - An excellent responsive design that will work across various screen sizes and platforms Ideal Candidate: The ideal candidate for this job should possess profound knowledge and extensive work experience in .NET core and Vue.js. An ability to develop a responsive design as well as an

    $20 (Avg Bid)
    $20 Avg Bid
    4 bids

    We are looking for ETL ODI Developer for long term contract role who can support us 8 hours a day from Mon- Friday Experience 7+ years Long Term Work Hours 10.30 am – 07.30 pm IST Remote Key Skills : • 7 + years’ experience in building function & store procedure using ODI too and 3+ Years in Project Management • Strong in Agile, JIRA • Design Data warehouse table and applicable documentation. • Develop table creation scripts and execute the scripts for the Database Administrator (DBA). • Analyze data sources and determine data relationships to pair with the business requirements documentation (BRD). • Familiarity with data quality issues and Exact, Transform, Load (ETL) processes • Design and develop Extract Load Transform ...

    $1366 (Avg Bid)
    $1366 Avg Bid
    8 bids

    Good day, I am looking for a specialist proficient in using something like Test Disk or other tool under UNIX to recover such data as Several installations of sites (FTP) Wordpress + SQL . The situation was, with the RAID in the online server room was damaged. They failed to rebuild anything, but I got a corrupted image of my virtual machine (170GB+-).

    $138 (Avg Bid)
    $138 Avg Bid
    53 bids

    Share Resumes. • Solutioning/Architecting/Developing Informatica Cloud Data Integration (CDI) and Cloud Application Integration (CAI) processes • Building/Unit Testing/Deploying the Mappings/Taskflows in CDI • Implement transformations within CDI mappings based on Business logic • Building CAI assets (Service Connectors, App Connections, Process Objects and Processes) to integrate applications in real time • Creating Functional Design Documents (FDD) for solutioning and sharing with Solution Architects and other team members to explain the development methods or procedures and follow the patterns to complete development • Bug fixing, Unit testing & UAT? Go-live & Production support • Training & Knowledge Transfer Essenti...

    $303 (Avg Bid)
    $303 Avg Bid
    3 bids

    I'm looking for an expert in Azure ETL pipelines who can help me maintain and optimize my existing structures. My primary focus is on data transformation of structured data. The role also involves carrying out any necessary data cleaning or enrichment processes during the transformation. Key tasks: - Data transformation optimization - Data cleaning - Data enrichment Ideal skills: - Extensive experience with Azure ETL pipelines - Proven ability with data transformation - Proficiency with structured data - Data cleaning and enrichment skills.

    $9 / hr (Avg Bid)
    $9 / hr Avg Bid
    13 bids

    I'm in need of a distinguished SQL developer with an adept background in ETL Testing within Snowflake. The successful candidate will be responsible for: - Carrying out efficient ETL Testing in Snowflake. This will involve knowledge in specific areas such as data extraction, data transformation, and data loading. - Execution and validation of SQL Test Cases. This specifically includes conducting data integrity tests and data retrieval tests. The ideal candidate should have proven experience in SQL development, ETL testing and knowledge in the Snowflake environment. An understanding of database design, query optimization, and database administration will be highly beneficial. The candidate should be detail-oriented and should have a keen eye for identifying and a...

    $1206 (Avg Bid)
    $1206 Avg Bid
    7 bids

    I'm seeking a highly skilled Data Engineer / Data Architect for my tech startup. Key Responsibilities: * Data modeling * Database design * Execution of ETL (Extract, Transform, Load) processes * Building and managing a Data Warehouse * Creating and managing API The core function of the Data Warehouse will be to integrate data from various sources. Ideal Skills & Experience: * Proficient in AWS * Strong foundation in Data modeling and Database design * Experience in building ETL processes * Knowledge in Data Warehouse construction, management, and data integration * API design and development Only apply if you are comfortable with AWS tech stack.

    $597 (Avg Bid)
    $597 Avg Bid
    23 bids

    We are seeking a candidate with robust proficiency in AWS and automation technologies, specifically utilizing Ansible, Terraform, Git, and Github. The ideal candidate should possess hands-on experience with these tools and demonstrate a strong understanding of CI/CD principles. Familiarity with UNIX/Linux commands and code repository platforms such as Git and Github is essential, along with the ability to define and implement CI/CD practices. The role requires developing automation strategies using Ansible and Terraform, as well as estimating project efforts accurately. Candidates should showcase both independent work capabilities and effective teamwork skills, with knowledge of user story estimation and Agile-Scrum methodologies. Cloud certifications are preferred. Additionally, th...

    $1482 (Avg Bid)
    $1482 Avg Bid
    26 bids

    I need a software development company to build a custom application to be used on a Windows platform. This app...platform. This application is aimed at generating reports from tally using data analytics . It will be an tax audit software ( am an CA ). I will retail the software. I have already prepared working model in power query. Ideal skills for this job include: - Advanced knowledge in software development - Familiarity with tally tdl - I want excel pivot table like UI - Expert in web scrapping and ETL function - knowledge of sql server ( I will provide raw data in sql ) - Good understanding of data management - Ability to convert this into single exe file - give me control panel . as I want to sell it furhur - on few areas AI may be used - integration with other software...

    $1346 (Avg Bid)
    $1346 Avg Bid
    8 bids

    I'm searching for a skilled data analyst who can help me perform an Extract, Load, Transform (ELT) task on my internal database. The chosen freelancer should: - Be able to handle a medium to high data volume (1 GB to 10 GB). - Have experience in extracting data from multiple sources. - Be familiar with loading data into Snowflake. - Understand how to transform data using HiTouch (reverse ETL). - Be efficient with data analysis using Mixpanel In-depth knowledge of Google Analytics is also beneficial. I expect you to have demonstrable experience in ELT tasks and be capable of delivering quality results accurately and timely. Your understanding of these processes will be crucial to the success of this project.

    $674 (Avg Bid)
    $674 Avg Bid
    21 bids

    I'm looking for an expert in ETL processes and Tableau. For my project, the right freelancer should be able to extract, transform, and load financial data. The information that should be included in the Tableau dashboard is revenue data, expense data and profit margin data. Key Skills and Experience: - Knowledge of ETL processes - Experience with Tableau - Background in Financial data analysis I require monthly updates on the dashboard. It's essential that you're detail-oriented, accurate, and timely. This job requires clear communication and a high level of precision. If you have the necessary skills and experience, please bid.

    $20 (Avg Bid)
    $20 Avg Bid
    14 bids

    ...guidance especially in the area of ETL processes. I need to focus on: - This is an interview support role, You are supposed to help in live interviews. • Extraction techniques – The primary data sources of my interest are platforms like Spark, AWS, Azure, GCP, and Hive. I want to understand effective methods for data extraction from these particular sources. Ideal Skills and Experience: - Expertise in ETL tools for data extraction - Hands-on experience with Spark, AWS, Azure, GCP, Hive - Profound knowledge in data engineering - Experience in career coaching or mentoring will be a bonus - SQL -Python This assistance will give me a competitive edge in my upcoming interviews by providing me with practical skills, knowledge, and confidence in addressing ETL...

    $18 / hr (Avg Bid)
    $18 / hr Avg Bid
    8 bids

    We are looking for Full Time employee who can work on our payroll. Responsibilities: ETL Development: ● Design, develop, and implement robust ETL processes using AWS Glue, AWS Data Pipeline, or custom scripts as needed. ● Ensure the efficient extraction, transformation, and loading of data from diverse sources into our data warehouse. Data Warehousing: ● Design and maintain data warehouse solutions on AWS, with a focus on scalability, performance, and reliability. ● Implement and optimize data models for efficient storage and retrieval in AWS Redshift. AWS Service Utilization: ● Leverage AWS services such as S3, Lambda, Glue, Redshift, and others to build end-to-end data solutions. ● Stay abreast of AWS developments and recommend the adoption of new services to enhance ou...

    $2347 (Avg Bid)
    $2347 Avg Bid
    8 bids

    I'm in need of a skilled developer with experience constructing ETL pipelines that extract data from CSV files. Main project tasks: - Extract data from CSV file source - Perform necessary transformations including data cleaning and data enrichment. Required experience and skills: - Proven track record in developing ETL pipelines - Proficiency in handling and processing CSV files - Expertise in performing data cleaning and data enrichment actions. This task requires fine attention to detail and a pragmatic approach to data management. I'm expecting an efficient and error-free pipeline construction. Your responsibility will be to ensure high-quality, cleaned, and enriched data output from the provided CSV files.

    $29 (Avg Bid)
    $29 Avg Bid
    22 bids

    Require ETL script to be written in Python /Django Task :Pull data from source and transform it into desired response API endpoint would be final delivery

    $17 (Avg Bid)
    $17 Avg Bid
    12 bids

    ...management, Triggers etc. ü Proven expert in Modeling enterprise-grade databases and architecture. Very strong at Entity Relationship. ü 5+ years of experience modeling loosely coupled relational databases that can store tera or petabytes of data. ü 3+ years of proven expert in working with large Data Warehouse. ü Must have ability to conceptualize ideas and data streams to schemas. ü Expert at ETL transformations using SSIS. ü Good knowledge of analytics tool like AWS Quick Sight. ü 4+ Years of proven experience working with high volume multi-client SAAS solutions. ü Must be expert at communicating technical issues to non-business users. ü Must have business-oriented thought process. ü Proven expert at setting up standards and co...

    $1534 (Avg Bid)
    $1534 Avg Bid
    15 bids

    ...train others. If you're skilled in data analysis, visualization, SQL, programming (Python, R), and other BI essentials, join us for global projects. What We're Looking For: Business Intelligence Experts with Training Skills: Data analysis, visualization, and SQL Programming (Python, R) Business acumen and problem-solving Effective communication and domain expertise Data warehousing and modeling ETL processes and OLAP Statistical analysis and machine learning Big data technologies (Hadoop, Spark) Agile methodologies and data-driven decision-making Cloud technologies (AWS, Azure) and data security NoSQL databases and web scraping Natural Language Processing (NLP) and sentiment analysis API integration and data architecture Why Work With Us: Global Opportunities: Collab...

    $21 / hr (Avg Bid)
    $21 / hr Avg Bid
    24 bids

    ...health to proactively tackle potential issues. - **Recovery and Backup:** Given our zero downtime goal, skills in setting up efficient backup and recovery processes are essential. You should be able to plan and implement strategies that ensure our data integrity and availability even in adverse scenarios. **Ideal Skills and Experience:** - Certified AWS DevOps Engineer - Strong background in Linux/Unix Administration - Proficiency in scripting languages like Python - Experience with Continuous Integration and Continuous Deployment (CI/CD) methodologies - Familiarity with security best practices in cloud environments - Problem-solving skills and a proactive approach to tackle scalability challenges This project is not just about maintaining the status quo but pushing boundarie...

    $176 (Avg Bid)
    $176 Avg Bid
    21 bids

    ?I c...Elastic beanstalk, S3, EFS, Storage gateway, Glacier, VPC, Direct connect, Transit Gateway, ELB, Auto Scaling, ACM, Cloud Front, Cloud Formation, Cloud Watch, Cloud Trail, SNS, SES, SQS, SWF, IAM, RDS, DynamoDB, Elasticache, Redshift, AWS Backup · Operating Systems: UNIX, Redhat LINUX, Windows · Networking & Protocols: TCP/IP, Telnet, HTTP, HTTPS, FTP, SNMP, LDAP, DNS, DHCP, ARP, SSL, IDM 6.0 and 7.0 · DevOps Tools: Puppet, Chef, Subversion (SVN), GIT, Jenkins, Hudson, Puppet, Ansible, Docker and Kubernetes · Scripting Languages: UNIX Shell Scripting (Bourne, Korn, C and Bash), Python, Perl Scripting, · Database: Oracle, Amazon Aurora, MySQL, MariaDB, PostgreSQL, Microsoft SQL Server · Version Controlling Tools: Subversio...

    $8 / hr (Avg Bid)
    $8 / hr Avg Bid
    1 bids

    We're looking for an amazing python dev to take over work on an a Python Flask container - mainly responsible for ETL and data analysis. You: - A strong developer with experience in data pipeline and data analysis work. - Expert in libraries like Pandas, NumPy, and other python data manipulation libs. - A familiarity with networking protocols such as Websockets, HTTP, and FTP. - Familiarity with Data Warehouses like BigQuery - Familiarity with Looker - Ability to support US West Coast hours Do you do your own coding, or do you coordinate development through an agency? Can you describe a recent project where you utilized Pandas and NumPy for data analysis or manipulation? What challenges did you face and how did you overcome them? Can you explain a scenario where you had to ...

    $19 / hr (Avg Bid)
    $19 / hr Avg Bid
    55 bids

    ...does not work. We have to delete the cert manually and renew manually. we need you to help us to fix this issue. **Requirements:** - In-depth knowledge of Ansible for automation. - Experienced with Debian server management. - Familiarity with Let's Encrypt SSL certificate renewal process. - Ability to implement an efficient email notification system. **Ideal Skills:** - Proficiency in Linux/Unix administration, especially Debian. - Strong background in security protocols, specifically SSL/TLS. - Experience with scripting and automation tools, with a focus on Ansible. - Good understanding of email systems for automated notifications. **Objectives:** - Automate the SSL certificate renewal process using Ansible. - Ensure minimal to no downtime during the renewal proces...

    $143 (Avg Bid)
    $143 Avg Bid
    42 bids