Skip to content

datacoon/russiannames

Repository files navigation

Russian Names

russiannames is a Python 3 library dedicated to parse Russian names, surnames and midnames, identify person gender by fullname and how name is written. It uses an embedded DuckDB engine over bundled Parquet datasets to speed-up name parsing — no database server required.

Documentation

Usage and API documentation lives in this README (see the sections below).

Installation

Install the library with pip:

pip install russiannames

The reference datasets (Parquet files) are bundled with the package, so no external database, download, or restore step is needed. NamesParser() works out of the box.

To use your own datasets, point the library at a directory containing names.parquet, surnames.parquet and midnames.parquet via either the NamesParser(data_dir=...) argument or the RUSSIANNAMES_DATA_DIR environment variable.

Features

Bundled Parquet datasets used for identification

  • 375449 surnames - dataset: surnames.parquet
  • 32134 first names - dataset: names.parquet
  • 48274 midnames - dataset: midnames.parquet

Detailed database statistics by gender and collection

collection total males females universal or unidentified
names 32134 19297 8278 4559
midnames 48274 30114 16143 2017
surnames 375449 124662 111534 139253

Supports 12 formats of Russian full names writing style

Format Example Description
f Ольга only first name
s Петров only surname
Fs О. Сидорова first letter of first name and full surname
sF Николаев С. full surname and first letter of surname
sf Абрамов Семен full surname and full first name
fs Соня Камиуллина full first name and full surname
fm Иван Петрович full first name and full middlename
SFM М.Д.М. first letters of surname, first name, middlename
FMs А.Н. Егорова first letters of first and middle name and full furname
sFM Николаенко С.П. full surname and first letters of first and middle names
sfM Петракова Зинаида М. full surname, first name and first letter of middle name
sfm Казаков Ринат Артурович full name as surname, first name and middle name
fms Светлана Архиповна Волкова full name as first name, middle name and surname

Supports names with following ethnics identification

9 ethnic types in names, surnames and middle names supported

key name (en) name (rus)
arab Arabic Арабское
arm Armenian Армянское
geor Georgian Грузинское
germ German Немецкие
greek Greek Греческие
jew Jew Еврейские
polsk Polish Польские
slav Slavic (Russian) Славянские
tur Turkic Тюркские (тюркоязычные)

Limitations

  • very rare names, surnames or middlenames could be not parsed
  • ethnic identification is still on early stage

Speed optimization

  • datasets are loaded into an in-memory DuckDB database and indexed on the lookup key (text) for fast exact-match queries

Usage and Examples

Parse name and identify gender

Parses names and returns: format, surname, first name, middle name, parsed (True/False) and gender

>>> from russiannames.parser import NamesParser
>>> parser = NamesParser()
>>> parser.parse('Нигматуллин Ринат Ахметович')
{'format': 'sfm', 'sn': 'Нигматуллин', 'fn': 'Ринат', 'mn': 'Ахметович', 'gender': 'm', 'text': 'Нигматуллин Ринат Ахметович', 'parsed': True}
>>> parser.parse('Петрова C.Я.')
{'format': 'sFM', 'sn': 'Петрова', 'fn_s': 'C', 'mn_s': 'Я', 'gender': 'f', 'text': 'Петрова C.Я.', 'parsed': True}

Gender field could have one of following values:

  • m: Male
  • f: Female
  • u: Unknown / unidentified
  • -: Impossible to identify

Command line

rusnames "Нигматуллин Ринат Ахметович"

Ethnic identification (experimental)

Parses surname, first name and middle name and tries to identify person ethic affiliation of the person

>>> from russiannames.parser import NamesParser
>>> parser = NamesParser()
>>> parser.classify('Нигматуллин', 'Ринат', 'Ахметович')
{'ethnics': ['tur'], 'gender': 'm'}
>>> parser.classify('Алексеева', 'Ольга', 'Ивановна')
{'ethnics': ['slav'], 'gender': 'f'}

Supported languages

  • Russian

Requirements

  • Python 3.9+
  • duckdb

Related projects

About

Russian names parsers, gender identification and processing tools

Topics

Resources

License

Stars

140 stars

Watchers

4 watching

Forks

Packages

 
 
 

Contributors