[Remote] Senior Data Engineer/Architect - Databricks

Note: The job is a remote job and is open to candidates in USA. Greystar is a leading, fully integrated global real estate platform offering expertise in property management, investment management, development, and construction services. They are seeking a Senior Data Engineer/Architect to join their D2AI team, focusing on leveraging Azure SQL, Cosmos DB, and Databricks to meet growing data demands and support customer-facing applications.Responsibilities100% hands-on development – Azure SQL, Cosmos DB, Databricks, and Azure OpenAI: develop and unit test database and AI pipeline code, including T-SQL, stored procedures, functions, views, and LLM prompt orchestration layersOwn and maintain the Databricks data ingestion & output pipelines for end programs such as greystar.com and Microsoft Customer Insights CDP platform, including Delta Lake table optimization, schema evolution, and medallion architecture (Bronze/Silver/Gold) designArchitect and maintain AI-ready data structures — clean, well-typed, and optimized for feature engineering and model consumptionParticipate in the design of databases and feature stores, applying normalization or denormalization as appropriate to support both operational and ML workloadsCreate, deploy, and maintain ADF and Databricks Workflows pipelines, adhering to Greystar's standards and documented best practicesPerform analysis of complex data and document findings, leveraging AI-assisted tooling and notebooks to surface insights fasterPrepare and curate data for prescriptive and predictive modeling — including feature extraction, data labeling pipelines, and training/test dataset constructionCombine raw data from disparate external sources; build and support complex ingestions including real-time streaming (Event Hub) and batch patternsCollaborate closely with data scientists, ML engineers, and application developers consuming the data — ensuring outputs are well-documented, versioned, and model-readyIntegrate and support AI/ML model outputs back into data products — scoring pipelines, inference result storage, and feedback loops for model monitoringPlay a direct role in the maintenance, technical support, documentation, and administration of databases and Databricks environments, including Unity Catalog governanceEnsure standards are followed by participating in code reviews — including review of AI prompt logic, notebook structure, and pipeline configurationAct as a thought leader: bring forward new ideas in AI, data engineering, and LLM integration — and then build themSkills6+ years relevant and progressive data engineering experienceDeep Technical knowledge and experience in Microsoft Azure architecture, including Azure PaaS databases, Synapse, ADF pipelines, Azure functions, Event Grids etc3+ Years of Experience with Cosmos DB3+ Years of Experience with Data BricksHands-on skills working with data pipelines using SQL and No-SQL databasesMinimum of 1 year of relevant experience working with Azure Data Lakes Gen 2Experience with Power Platform / Power BIExperience in engineering practices such as code refactoring, design patterns, CI/CD, and highly scalable data applicationsExperience developing batch ETL pipelines; real-time pipelines are a plusKnowledge of advanced data engineering concepts such as dimensional modeling, ETL, data governance, data warehousing, structured and unstructured dataGood Experience with Python, machine learning frameworks and statisticsKnowledge of Agile software development processExcellent problem-solving skills and experienceStrong communication and collaboration skills"Self-starter" attitude and the ability to make decisions with minimal guidance from othersInnovative and passionate about your work and the work of your teammatesAbility to comprehend and analyze operational systems and ask appropriate questions to determine how to improve, migrate or modify the solution to meet business needsExperience / Familiarity with D365 Customer Insights platform / Dataverse is a plusDatabricks or other Certifications are nice to have but not requiredAdvanced degree preferredBenefitsCompetitive pay, benefits, and overall compensation packages.100% Remote flexibility!Corporate Positions: In addition to the base salary, this role may be eligible to participate in a quarterly or annual bonus program based on individual and company performance.Onsite Property Positions: In addition to the base salary, this role may be eligible to participate in weekly, monthly, and/or quarterly bonus programs.Competitive Medical, Dental, Vision, and Disability & Life insurance benefits.Low (free basic) employee Medical costs for employee-only coverage; costs discounted after 3 and 5 years of service.Generous Paid Time off.All new hires start with 15 days of vacation, 4 personal days, 10 sick days, and 11 paid holidays.Plus your birthday off after 1 year of service!Additional vacation accrued with tenure.For onsite team members, onsite housing discount at Greystar-managed communities are available subject to discount and unit availability.6-Week Paid Sabbatical after 10 years of service (and every 5 years thereafter).401(k) with Company Match up to 6% of pay after 6 months of service.Paid Parental Leave and lifetime Fertility Benefit reimbursement up to $10,000 (includes adoption or surrogacy).Employee Assistance Program.Critical Illness, Accident, Hospital Indemnity, Pet Insurance and Legal Plans.Charitable giving program and benefits.Benefits offered for full-time employees.For Union and Prevailing Wage roles, compensation and benefits may vary from the listed information above due to Collective Bargaining Agreements and/or local governing authority.Company OverviewGreystar provides services in the multifamily real estate businesses. It was founded in 1993, and is headquartered in Charleston, South Carolina, USA, with a workforce of 10001+ employees. Its website is http://greystar.com.