No Third Parties
W2 only - Must be available to work with no sponsorship needed now or in the future.
LOCAL CANDIDATES PREFERRED!!
The ideal candidate must have 8+ years of hands-on data engineering experience building large-scale ETL pipelines using Apache Spark, Hadoop, Python, and SQL. They also need a strong background in the payments or financial sector, paired with excellent communication skills to effectively influence and partner with cross-functional teams.
***OnlyโqualifiedโBigโDataโEngineerโcandidatesโlocatedโnearโArlington,โVAโtoโbeโconsideredโdueโtoโtheโpositionโrequiringโanโonsiteโpresence.โ***
RequiredโEducation
โข Bachelor''''sโdegreeโinโaโquantitativeโdisciplineโsuchโasโEngineering,โMathematics,โFinance,โBusiness,โorโaโrelatedโfield.โEquivalentโpracticalโexperienceโmayโalsoโbeโconsidered.
RequiredโQualifications/Skills/Experience:
โข ExperienceโasโaโDataโEngineerโorโinโaโsimilarโrole,โwithโaโstrongโunderstandingโofโdataโengineeringโconceptsโandโmethodologies.
โข StrongโknowledgeโofโwritingโandโoptimizingโSQLโqueriesโtoโretrieve,โmanipulate,โandโanalyzeโdataโefficiently.
โข Hands-onโexperienceโwithโbigโdataโtechnologiesโsuchโas:
โข ApacheโSparkโ(PySpark,โSparkโSQL,โSparkโStreaming)
โข Hadoopโecosystemโ(HDFS/โOzone,โHive,โYARN)
โข Understandingโdataโmodelingโconceptsโandโdatabaseโdesignโtoโsupportโscalableโdataโsolutions.
โข FamiliarityโwithโPython.
โข Abilityโtoโanalyzeโandโtroubleshootโdataโissuesโandโprovideโsolutionsโwithโminimalโsupervision.
โข Basicโknowledgeโofโtestingโandโvalidatingโdataโtoโensureโaccuracyโandโconsistencyโinโdataโpipelines.
โข Excellentโverbalโandโwrittenโcommunicationโskills,โwithโtheโabilityโtoโarticulateโcomplexโideasโclearlyโandโconciselyโtoโbothโtechnicalโandโnon-technicalโstakeholders.
Role:
Thisโroleโfocusesโonโdesigning,โimplementing,โandโmaintainingโscalableโenterpriseโETLโprocessesโandโrobustโdataโpipelinesโforโaโglobalโclientโbase.โYouโwillโleverageโbigโdataโframeworksโlikeโApacheโSparkโandโHadoop,โalongโwithโSQLโandโPython,โtoโoptimizeโdataโprocessingโandโensureโhighโdataโquality.โWorkingโcloselyโwithโcross-functionalโteams,โyouโwillโautomateโroutineโtasksโandโdeliverโaccurate,โhigh-valueโdataโsolutionsโacrossโvariousโindustries.
Responsibilities:โ
โขโSupportโtheโdesign,โimplementation,โandโmaintenanceโofโenterpriseโETLโprocessesโforโdataโplatforms,โforโaโglobalโclientโbase.
โขโDevelopโscalableโandโefficientโcodeโtoโprocessโdata,โensuringโavailabilityโandโaccessibilityโinโaโtimelyโmanner.
โขโLeverageโbigโdataโprocessingโframeworksโsuchโasโApacheโSparkโandโHadoopโtoโbuildโandโoptimizeโdataโpipelines.
โขโCollaborateโwithโseniorโengineersโtoโaddressโdataโchallenges,โcontributingโtoโsolutionsโthatโmaintainโhighโdataโquality.
โขโAssistโinโtheโdataโdeliveryโprocess,โworkingโalongsideโDataโEngineersโandโAnalystsโtoโsupportโaccurate,โhigh-valueโdataโsolutionsโacrossโvariousโclientsโandโindustries.
โขโBuildโstrongโworkingโrelationshipsโwithโteamโmembersโandโclients,โcontributingโtoโbothโlocalโandโglobalโprojects.
โขโLearnโandโapplyโindustryโbestโpractices,โincludingโversionโcontrol,โcodeโreviews,โandโdataโvalidation,โtoโensureโqualityโinโdataโprocesses.
โขโUseโSQLโandโotherโdatabaseโtechnologiesโtoโhelpโoptimizeโdataโprocessingโandโreduceโtheโtimeโrequiredโtoโhandleโlargeโdataโsets.
โขโDesign,โimplement,โandโmaintainโdataโpipelinesโusingโETLโframeworks,โorchestrationโtools,โandโdistributedโdataโprocessingโengines.
โขโParticipateโinโeffortsโtoโautomateโroutineโdataโtasksโandโstreamlineโprocesses.
โขโComplyโwithโallโMastercardโinternalโpoliciesโandโadhereโtoโexternalโregulations.