Data Infrastructure Job Description
Data infrastructure
provides on demand data processing and transfer using ETL tools using a variety of languages and frameworks including R, Python, Airflow and Docker.
Data Infrastructure Duties & Responsibilities
To write an effective data infrastructure job description, begin by listing detailed duties, responsibilities and expectations. We have included data infrastructure job description templates that you can modify and use.
Sample responsibilities for this position include:
Leverage a wide array of infrastructure technologies such as Hadoop, Hive, PostgreSQL, Cassandra, RabbitMQ, Puppet, Kafka, Storm, and be ready to contribute to open source
Continuously design, develop, and deploy services as part of our core promotional and advertising platform
Work primarily in Java, spanning other languages as needed
Collaborative with other software engineers, taking learning and leadership opportunities that will arise every single day
Develop measurement approaches and leverage these to evaluate features and system metrics continuously
Be incredible
Ensures the simple and effective access to infrastructure data, by defining and managing the service interfaces to infrastructure data
Plan and deliver an extensible data and business intelligence strategy that will significantly reduce decision-making cycle time or increase its impact
Become an expert of AWS services that we leverage
Plan and coordinate across CSRE teams, vendors and tech
Data Infrastructure Qualifications
Qualifications for a job description may include education, certification, and experience.
Licensing or Certifications for Data Infrastructure
List any licenses or certifications required by the position: OS, ITIL, BCSI, TOGAF, RHCE, AI, SSL, IIS, SAS, OSHA
Education for Data Infrastructure
Typically a job would require a certain level of education.
Employers hiring for the data infrastructure job most commonly would prefer for their future employee to have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Statistics, Mathematics, Technical, Information Technology, Management, Education, Business, Science
Skills for Data Infrastructure
Desired skills for data infrastructure include:
HTTP
Cassandra
HBASE
Python
Private Kubernetes frameworks for scaling data and services infrastructure
Using public
SQL
API and RESTful Web Services development
Algorithms
Linux operating system
Desired experience for data infrastructure includes:
Ability to present to small/ large groups of technicians board members
Very good data modeling skills
Expertise in advanced structured cabling tasks including fiber routing and termination of fiber (fusion splice), twisted pair, and coaxial copper runs
Familiar with all aspects of optical components, including, programmable attenuators, EO/OE devices, fusion splicing, connector types, couplers, splitters, switches, combiners and other fiber optic components
Experience with various types of network circuits including OC-n, DS1/3, and Gigabit Ethernet
Ability to collaborate and work closely with the Network Operations team on the lay-out and design of the network
Data Infrastructure Examples
1
Data Infrastructure Job Description
Job Description Example
Our company is looking to fill the role of data infrastructure. If you are looking for an exciting place to work, please take a look at the list of qualifications below.
Responsibilities for data infrastructure
- Act as supplier Technical lead for the Migration Stream and Migration facility build
- Represent the Migration stream within the Technical Design Authority
- Technical ownership and mitigation of key technical risks
- Will work to define Next Generation Hosting service offerings
- Gather and document functional and nonfunctional requirements for Next Generation services
- Work with IT Finance to manage the financial aspects of the Next Generation environment
- Manage Data Center capacity and create forward projections
- Coordinate work with IT Infrastructure engineering teams to define technical solutions for the Next Generation Data Center
- Coordinate service offerings with IT Operations and assist with operational documentation
- Assist with process improvements across various aspects of our business
Qualifications for data infrastructure
- You have deep experience with Linux/Unix systems
- You have deep experience with modern storage platforms (KV stores not just RDBMSs)
- Knowledge of and experience with TCP/IP, IPX/SPX, network topology and other network protocols
- Knowledge of best data center practices, such as hot aisle / cold aisle rack configurations, and how to rack and cable to maximize cooling
- Interpret and verify work orders, specifications, drawings, and perform site inspections
- Able to read and interpret schematics, wire connection lists and mechanical drawings
2
Data Infrastructure Job Description
Job Description Example
Our company is growing rapidly and is hiring for a data infrastructure. Please review the list of responsibilities and qualifications. While this is our ideal list, we will consider candidates that do not necessarily have all of the qualifications, but have sufficient experience and talent.
Responsibilities for data infrastructure
- Global metrics processing using multiple Excel data sources
- Administration of an internal SharePoint website
- Present Next Generation Data Center topics to Senior IT and Business management
- Identify industry trends that affect Next Generation Data Center and Hosting Services
- Occasional assistance to other Connected X planning teams with emerging requirements and projects
- Deliver high-quality, value-add data, tools and / or insights that drive improved decision making, moving the business forward and achieves commercial outcomes
- Develop a deep understanding of the business to ensure that data and analysis is embedded in everyday decision-making, and that operational simplification agendas re fully supported using the appropriate technologies
- Continuous focus to ensure data infrastructure remain up-to-date and accurate and are maintained in accordance with agreed deadlines and established business processes
- Drive operational efficiency across the team and focus on quality and scalability of business processes
- Oversee all electrical systems installations and modifications
Qualifications for data infrastructure
- Low-voltage cabling standards and practices, fiber-optic cabling standards and test procedures, and data infrastructure design
- Fiber Optics Installation and Maintenance/Certification
- Bachelor's Degree in Risk-related field (Accounting, Business, Economics, Finance, Math/Stat, Operations Research, with Quantitative underpinning) with 5+ years of relevant Risk or Finance experience
- Enterprise level Telecommunication Cabling technician experience
- Metal fabricaton experience
- Knowledgeable of Data Center IT infrastructure
3
Data Infrastructure Job Description
Job Description Example
Our company is growing rapidly and is searching for experienced candidates for the position of data infrastructure. If you are looking for an exciting place to work, please take a look at the list of qualifications below.
Responsibilities for data infrastructure
- Guides the development of applications, systems, technical and product standards based on long range plans and vision
- Support the local area network (LAN) route, switch, and wireless infrastructure including installation and support of hardware, upgrades, and/or patches
- Design, implement, monitor, and document network topologies to ensure optimal system performance and access in a 24/7/365 environment
- Provide environmental design and layout criteria for network facilities, cabling infrastructure, equipment, and other devices
- Develop technical requirements and test plans to evaluate vendor products, services, proposals, and bids
- Develop and maintain regular plans to support vendor releases for network hardware, operating systems, and software
- Ensure adequate network services, capacity, and availability (e.g., bandwidth, switch ports, cables, and connectivity)
- Design, develop, and maintain remote access and connectivity services (e.g., VPN)
- Develop and maintain documentation of current configurations including the baseline templates and optimal configurations and generate regular change reports
- Monitor the daily backup of network devices, run regular test restores, and ensure that newly installed devices are configured for backup and disaster recovery
Qualifications for data infrastructure
- Must be of physical condition to support this physically demanding position
- Knowledge/experience storing and querying large amounts of data a plus
- Knowledge of Linux, parallel processing, bash scripting a plus
- Experience with distributed big data processing systems like Hadoop, Presto, or Spark is a big plus
- High-level functional understanding of web applications
- Knowledge of data warehousing principles including data modeling, data quality, extract/transform/load process, job scheduling and indexing
4
Data Infrastructure Job Description
Job Description Example
Our growing company is looking to fill the role of data infrastructure. To join our growing team, please review the list of responsibilities and qualifications.
Responsibilities for data infrastructure
- Provide technical support and guidance to end-users and stakeholders
- Assist the development, documentation, and implementation of technical and operational policies and procedures that conform to the CSU Standard Operating Environment (SOE), industry standards, and best practices
- Install, configure, and manage network firewall devices, security appliances, and maintain/document appropriate access procedures
- Routinely perform security risk analyses to identify network vulnerabilities and generate intrusion prevention and detection reports
- Recommend and implement counteractive security measures proactively and in response to security breaches and apply approved security patches
- Recommend and implement counteractive security measures proactively, and in response to incidents
- Respond to incidents and security breaches providing root cause analysis
- Determine Data Center storage needs with an emphasis on scalable technologies that will meet current and future requirements
- Research new storage devices and technologies and provide recommendations as needed
- Develop, implement, and maintain a Standard Operating Environment (SOE)
Qualifications for data infrastructure
- Understanding of financial and operational tools and applications such as PeopleSoft, Essbase, including GS in-house tools such as GS Space, TEEMS
- Engineering, Computer Science, Business, or Mathematics degree
- Bachelor’s degree in Computer Science, Mathematics, Electrical Engineering, or Computer/Software Engineering from an accredited institution and some professional work experience
- The ability to implement models and tools through the use of modeling environments such Azure ML and R
- Experience with very large-scale data
- Very strong statistical knowledge, machine learning and data-modeling experience
5
Data Infrastructure Job Description
Job Description Example
Our growing company is searching for experienced candidates for the position of data infrastructure. Thank you in advance for taking a look at the list of responsibilities and qualifications. We look forward to reviewing your resume.
Responsibilities for data infrastructure
- Manage the storage lifecycle including determining and implementing methods for evaluating and archiving content on an ongoing basis
- Troubleshoot and provided day-to-day support of storage
- Implement, configure, and maintain virtual environments and technology, including VMWare ESXi, vSphere, vCenter, vSphere replication, iSCSI data stores, and virtual distributed switches
- Ensure production, stage, and lab virtual infrastructure availability and health
- Support training activities and efforts
- Creation and maintenance of detailed project schedules
- Continuous evaluation of resourcing against deliverables and timelines
- Identification and mitigation of technical risks and issues
- Liaise with external parties and vendor partners who must deliver on commitments
- Develop new and enhance existing features of massively distributed mission critical data systems owned by DDE group
Qualifications for data infrastructure
- Working knowledge in a scripting (Python, Javascript, Ruby) or compiled language (Java, C/C++)
- Experience with algorithms
- Industrial controls and building automation systems
- Facilities power delivery, power monitoring, UPS/ Energy storage solutions
- Availability and reliability modeling including Failure tree analysis, reliability block diagrams, modeling and simulation (PLC/Relex, Etap, etc)
- 5+ years of data science experience with demonstrated excellence in big data analytics