弗拉基米尔•Senatorov
Verified Expert in Engineering
数据工程师和软件开发人员
Vladimir has been developing database solutions for 20+ years in developer, architect, 以及团队领导角色. He has specialized in data integration and transformation for data warehouses, BI systems, 处理采矿系统, 使用SQL和ETL工具. Over the years, Vladimir has proven his ability to use non-trivial approaches to effectively solve challenging data processing problems.
Portfolio
Experience
Availability
首选的环境
PostgreSQL, Celonis, SQL, Azure数据工厂, Azure SQL数据库, Microsoft SQL Server, Oracle, Python, Apache Airflow, Microsoft Power BI
The most amazing...
...我设计和开发的系统是一个bi报告工具, combining a relational OLAP approach with the full-text search capabilities of MS SQL Server.
Work Experience
高级数据工程师,流程挖掘
RAMAX国际
- Designed and developed data integrations from production systems to data warehouses for process-mining solutions for three projects. The integrations were built using Pentaho 数据集成 (PDI) and Apache Airflow.
- Developed SQL transformations of digital footprints of processes into more than seven process-mining data models. 优化SQL转换的性能.
- Administered the Celonis server, Apache Airflow, Jenkins, and PostgreSQL.
Data Engineer
Azrieli电子商务有限公司.
- Developed Azure数据工厂 (ADF) pipelines for integration of various data sources—Sylius (retail sales), Mirakl(批发采购), AirTable (BI系统的数据输入), 客户(与客户聊天), 加上一些遗留系统.
- Set up several processes for consuming REST API paginated outputs from various endpoints using ADF. 为接收到的REST API JSON数据设置一些数据解析过程.
- Developed SQL Server back-end data structures and stored procedures to work with ADF pipelines. Created SQL Server stored procedures for regular copying data between DWH areas and updating the slowly changing dimensions (type 2).
高级顾问
Tern Group
- Developed, 作为团队的一员, 一个基于MS sql的医药数据分析数据仓库, 包括零售额, wholesales, 医疗代表推广数据, and more.
- Developed, 作为团队的一员, a PL/SQL-based, 用于通过基于web的前端检索信息的后端API.
- Developed XML-data integrations and transformations using SAP BODS and Oracle.
架构师、开发人员
Self-employed
- 开发了一个集成XML文件的系统. The system provided daily conversion of thousands of files (dozens of XSD schemas) into a single analytical data mart.
- Designed a reporting engine that produced analytical output from structured-relational data and full-text indexes of unstructured files in office formats.
- Developed a "semaphore" system that coordinates various tasks such as FTP download, unzipping, 上传至数据库, 数据转换, 下载http文件进行全文索引, 数据更新管道中的分析数据集市更新.
团队领导、架构师、开发人员
Remedium Group
- Designed a set of analytical tools for clients to study pharmaceutical audit data and create their reports. The tools (several versions) were universal ROLAP-type report generators based on the MS SQL data engine.
- Developed a management-accounting system for the holding company (15+ legal entities), 包括通过MS Access表格输入数据, MS SQL作为数据存储, and MS Excel as a reporting engine connected to the database via pivot tables.
- Designed a data-processing pipeline for drug audits (retail and hospital), 包括数据收集, data integration, MDM并将源数据桥接到主字典, 统计外推法, 以及向客户交付审计数据.
- 制定并监督执行一项长期的, 收购后与IMS Health (iqvia)的SLA.com), covering terms, conditions, and benchmarks of the outsourcing services provided to IMS by the employer (the Remedium Group).
Experience
控股公司管理会计制度
The financial analyst of the holding was performing data entry by companies with a breakdown by projects, periods, 以及归属于成本和利润中心的费用项目.
The user interface for the data entry was developed using MS Access forms.
系统的后端是一个MS SQL数据库.
Reporting was developed using MS Excel connected to the database via the pivot-tables mechanism.
XLM数据集成框架
1. Loading the contents of XML files of various schemas into a single database table.
2. 将XML模式的XSD文件解析为表格格式.
3. Using table (2) information to create templates for mapping source data elements to the target database structure.
4. Applying templates (3) to loaded data (1) to automatically transform source XML files data into the target relational data structure.
The implemented system made it possible to set up the daily integration of open public procurement data (zakupki.gov.ru),每天由数十个模式的数千个XML文件组成.
ITSM流程挖掘解决方案
解决方案包括:
1. 构建本地过程挖掘数据仓库(PostgreSQL), updated hourly from production assyst system (MS SQL) using incremental sync. 该同步是使用Pentaho DI开发的.
2. Applying transformations of source data into the process mining data model. The model contained all types of high-level ITSM tasks (incidents and change requests) and "child" tasks and decision tasks for each instance. 转换是使用pgSQL开发的. The model included many additional attributes and measures obtained from the source data and calculated on the fly.
3. Setting up regular (hourly) updates of the Celonis data model using Jenkins.
Skills
Languages
t - sql (transact - sql), SQL, Excel VBA, Python, Visual Basic for Applications (VBA), 存储过程, Visual Basic, XML, Snowflake, Visual Basic 6 (VB6), C#, Java
Libraries/APIs
REST APIs
Tools
Microsoft Access, Microsoft Excel, Microsoft Power BI, Power Pivot, Apache Airflow, Jenkins, GitHub, Pentaho数据集成(Kettle), Akeneo, Asana, Tableau
Paradigms
ETL, 维度建模, 商业智能(BI), Database Design, 数据库开发, OLAP, ETL实施 & Design
Platforms
Oracle, Azure, Azure SQL数据仓库, 专用SQL池(以前称为SQL DW), Linux, Databricks
Storage
PL/SQL, PostgreSQL, SQL Server集成服务(SSIS), Microsoft SQL Server, 数据集成, Databases, SQL Server DBA, Data Pipelines, 关系数据库, 数据库管理, SQL Server 2016, Azure SQL数据库, JSON, 数据库管理(DBA), Oracle PL/SQL, 数据库体系结构, Dynamic SQL, OLTP, SQL存储过程, 主数据管理(MDM), SQL Server分析服务(SSAS), Azure云服务, SQL Server报表服务(SSRS), NoSQL, Azure SQL
Other
Celonis, Excel Expert, 数据仓库, Pivot Tables, 工程数据, Data Modeling, Cloud, Process Mining, Data Analytics, Data Analysis, 数据架构, 数据仓库设计, 技术作家, 技术写作, APIs, Analytics, Azure数据工厂, 性能调优, 查询组成, 查询优化, Back-end, Data, Data Migration, ETL Tools, Data Management, PL/SQL Tuning, ELT, Excel 365, Data Structures, Dashboards, 解决方案架构, 技术架构, Data Governance, Optimization, ETL Development, ETL Testing, BI Reporting, Data Feeds, Data Extraction, Leadership, Warehouses, 业务需求, 仪表盘的设计, 非结构化数据分析, Pipelines, SAP业务对象数据服务(BODS), Mathematics, Statistics, Programming, System Design, SAP业务对象(BO), 数据可视化, 微软Azure云服务器, Airtable, 数据构建工具(dbt), 系统管理, SSRS Reports, DAX, English, eCommerce, Metabase, Mirakl, Kustomer, Unix Shell脚本, Azure Databricks
Frameworks
Sylius, .NET
Education
信息学与应用数学硕士学位
Institute of Cryptography, Telecommunications and Computer Science - Moscow, Russia
Certifications
Celonis实施专业
Celonis Academy
Celonis数据工程师
Celonis Academy
SAP Certified Application Associate - 数据集成 with SAP Data Services 4.2
SAP SE
如何使用Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
分享你的需求
选择你的才能
开始你的无风险人才试验
对顶尖人才的需求很大.
Start hiring