Colección SciELO Chile

Departamento Gestión de Conocimiento, Monitoreo y Prospección
Consultas o comentarios: productividad@anid.cl
Búsqueda Publicación
Búsqueda por Tema Título, Abstract y Keywords



A predictive approach for dynamic replication of operators in distributed stream processing systems
Indexado
WoS WOS:000905612800013
Scopus SCOPUS_ID:85145880794
DOI 10.1109/SBAC-PAD55451.2022.00023
Año 2022
Tipo proceedings paper

Citas Totales

Autores Afiliación Chile

Instituciones Chile

% Participación
Internacional

Autores
Afiliación Extranjera

Instituciones
Extranjeras


Abstract



Stream Processing Systems (SPSs) can present significant fluctuation in input rate. To address this issue, some existing solutions propose reconfiguring the SPS by replicating its operators. However, such reconfiguration usually induces a high system downtime cost. Moreover, reconfiguration decisions are based only on resource utilization without balancing the load between replicas. We propose in this paper a predictive SPS that dynamically defines the necessary number of replicas of each operator based not only on the current resource utilization and input rate variation but also on the events that, due to the operator's overloading, could not be processed yet and are, thus, kept in the operator's queue. In addition, our SPS implements a load balancer that distributes incoming events more evenly among replicas of an operator. Our solution has been integrated into Storm. To avoid system reconfiguration downtime, our SPS preallocates a pool of replicas where each of them can be activated or deactivated based on per operator input load predictions. Using real traffic traces with different applications, we have conducted experiments on Google Cloud Platform (GCP), evaluating our SPS and comparing it with Storm and DABS-Storm.

Revista



Revista ISSN
1550-6533

Métricas Externas



PlumX Altmetric Dimensions

Muestra métricas de impacto externas asociadas a la publicación. Para mayor detalle:

Disciplinas de Investigación



WOS
Sin Disciplinas
Scopus
Sin Disciplinas
SciELO
Sin Disciplinas

Muestra la distribución de disciplinas para esta publicación.

Publicaciones WoS (Ediciones: ISSHP, ISTP, AHCI, SSCI, SCI), Scopus, SciELO Chile.

Colaboración Institucional



Muestra la distribución de colaboración, tanto nacional como extranjera, generada en esta publicación.


Autores - Afiliación



Ord. Autor Género Institución - País
1 Wladdimiro, Daniel Hombre Sorbonne Université - Francia
Sorbonne Univ - Francia
2 Arantes, Luciana Mujer Sorbonne Université - Francia
Sorbonne Univ - Francia
3 Sens, Pierre Hombre Sorbonne Université - Francia
Sorbonne Univ - Francia
4 HIDALGO-CASTILLO, NICOLAS ANDRES Hombre Universidad Diego Portales - Chile
5 IEEE Comp Soc Corporación

Muestra la afiliación y género (detectado) para los co-autores de la publicación.

Financiamiento



Fuente
CONICYT FONDECYT
DOCTORADO BECAS
Agencia Nacional de Investigación y Desarrollo
Google Cloud
STIC-AmSud ADMITS
National Agency for Research and Development National Agency for Research and Development
National Agency for Research and Development National Agency for Research and Development (ANID) Program/DOCTORADO BECAS CHILE/2018

Muestra la fuente de financiamiento declarada en la publicación.

Agradecimientos



Agradecimiento
This work was funded by the National Agency for Research and Development National Agency for Research and Development (ANID) / Scholarship Program / DOCTORADO BECAS CHILE / 2018 - 72190551. This material is based upon work supported by Google Cloud. Nicolas Hidalgo wants to thank the project CONICYT FONDECYT Nº 11190314, Chile and to STIC-AmSud ADMITS Nº 20-STIC-01.
This work was funded by the National Agency for Research and Development National Agency for Research and Development (ANID) / Scholarship Program / DOCTORADO BECAS CHILE / 2018 - 72190551. This material is based upon work supported by Google Cloud. Nicolas Hidalgo wants to thank the project CONICYT FONDECYT Nº 11190314, Chile and to STIC-AmSud ADMITS Nº 20-STIC-01.
This work was funded by the National Agency for Research and Development National Agency for Research and Development (ANID)/Scholarship Program/DOCTORADO BECAS CHILE/2018 -72190551. This material is based upon work supported by Google Cloud. Nicolas Hidalgo wants to thank the project CONICYT FONDECYT N degrees 11190314, Chile and to STIC-AmSud ADMITS N degrees 20-STIC-01.

Muestra la fuente de financiamiento declarada en la publicación.