I would like to write down the elements that make up Luigi, including the meaning of organizing within myself. I will add more as needed. I would appreciate it if you could point out that there may be some misunderstandings.
--The unit of processing that makes up the workflow. --Tasks are dependent on each other in the workflow. --There are two types of data passed between tasks: parameters and targets. --The success of the task is to create a file to the target specified by the output () method. --A task failure is an exception within the task. --The file generated by the success of the task is also used as a checkpoint, and if the file exists, the task does nothing and is treated as successful. --The target returned by the output () method of the dependent task can be accessed as the input () method from the dependent task.
--An interface to provide access to various file systems. --It includes a mechanism that provides a buffer reader / writer and a client for connecting to a specific file system depending on the mode at the time of open. --The format is used when actually accessing the file.
--An interface to provide access to various files. --Provides processing for writing / reading depending on the mode at the time of open () of the target.
--There are two types: normal dependence and dynamic dependence. --Normal dependencies are used for dependencies that can be statically formed during programming = when the number of tasks to be performed is known in advance. --Dynamic dependency is used when a dependency cannot be formed at the time of programming = When the number of tasks to be performed depends on the data passed by input () of that task.
Recommended Posts