博文
Airflow SSH operator example
(2024-04-29 16:27:10)
fromairflowimportDAG
fromairflow.operators.ssh_operatorimportSSHOperator
fromdatetimeimportdatetimedefault_args={
'owner':'airflow',
'depends_on_past':False,
'start_date':datetime(2024,4,29),
'email_on_failure':False,
'email_on_retry':False,
'retries':1
}dag=DAG('ssh_example',default_args=default_ar...[阅读全文]
阅读 () ┆ 评论 (0)
Airflow , bashOperator and other
(2024-04-29 16:25:17)
BashOperator:ThisoperatorallowsyoutoexecuteabashcommandorscriptasataskwithinyourDAG. PythonOperator:ThisoperatorenablesyoutorunarbitraryPythonfunctionsastaskswithinyourDAG. Besidesthesetwo,Airflowprovidesawiderangeofoperatorstosuitvariousneeds.Someoftheothercommonlyusedoperatorsinclude: BranchPythonOperator:ThisoperatorallowsyoutoexecutedifferenttasksinyourDAGbasedontheresultofaPythonfunction...[阅读全文]
阅读 () ┆ 评论 (0)
ClassMethod and staicMethod in Python Class
(2024-04-28 16:54:08)
1.Classmethods(using@classmethoddecorator): Purpose:Classmethodsoperateontheclassitselfratherthanspecificinstances.Theyareoftenusedfor: Factorymethods:Creatingobjectswithdifferentconfigurationsbasedonprovidedarguments. Utilityfunctions:Performingactionsrelatedtotheclassasawhole,suchasvalidationordatamanipulation. Calling:Youcallclassmethodsusingtheclassnamefollowedbyadotandthemethodname(e.g.,...[阅读全文]
阅读 () ┆ 评论 (0)
IAM 的各个组成部分
(2024-04-26 14:13:12)
IAM(IdentityandAccessManagement)typicallyencompassestwomaincomponents:IdentityManagementandAccessManagement.1.**IdentityManagement(IDM)**:
-**UserProvisioningandDe-provisioning**:Managingthelifecycleofuseraccounts,includingcreating,modifying,andremovingthem.
-**Authentication**:Verifyingtheidentityofusersattemptingtoaccessresources,oftenthroughpasswords,biometrics,ormulti-factorauthenticat...[阅读全文]
阅读 () ┆ 评论 (0)
OpenStack 云和 services\'s name
(2024-04-26 10:47:44)
InOpenStack,eachservicetypicallyhasaprojectnameorcodenamethatisusedinternallywithintheOpenStackcommunityandsometimesexternallybyusersandoperators.HerearesomeofthecoreOpenStackservicesalongwiththeirprojectnames:1.**Nova**:NovaisthecomputeserviceinOpenStack,responsibleformanagingandprovisioningvirtualmachines(VMs).Itsprojectnameis"Nova."2.**Swift**:SwiftistheobjectstorageserviceinOpenStack...[阅读全文]
阅读 () ┆ 评论 (0)
GCP 的 主要 service 列表
(2024-04-26 10:41:42)
GoogleCloudPlatform(GCP)offersavarietyofcomputing,storage,pipeline,andotherpopularservices.Herearesomeofthemostcommonlyusedones:1.**ComputeEngine**:Thisserviceprovidesvirtualmachines(VMs)thatrunonGoogle'sinfrastructure.It'ssimilartoAmazonEC2inAWS.2.**AppEngine**:Aplatform-as-a-service(PaaS)offeringthatallowsdeveloperstobuildanddeployapplicationswithoutmanagingtheunderlyinginfrastructure.3....[阅读全文]
阅读 () ┆ 评论 (0)
redhat linux : python installing mysqlclient - mysql_config o
(2024-04-25 17:47:02)
whenweinstallmysql,postgresqlpacakage,weneedinstallmysql-develandlibpq-devel,pythonneedbinaryofthe2package InRedhat,wecanrun: $sudodnfinstallgccmysql-develpython3-devel, ifwemeetthesimilarissueswhenrun"pipinstallpsycopg2"(thisispythonPostgresqlpkg) error:pg_configcannotbefound wecanrun: $sudodnfinstalllibpq-devel whentheabovestepisfinished,andgood, thenrun ...[阅读全文]
阅读 () ┆ 评论 (0)
Oracle IAM , components list as far as I know
(2024-04-22 08:36:51)
TheOracleIdentityandAccessManagementSuitePlus(OracleIAMSuitePlus)typicallyincludesacomprehensivesetofcomponentsaimedatprovidingorganizationswithrobustidentityandaccessmanagementcapabilities.Thesecomponentsaredesignedtoaddressvariousaspectsofidentitygovernance,accessmanagement,anddirectoryservices.Whilethespecificcomponentsmayvarybasedontheversionandconfigurationofthesuite,somecommoncomponentsinclu...[阅读全文]
阅读 () ┆ 评论 (0)
主要PYTHON ETL 包
(2024-04-20 18:19:00)
popularPythonpackagesforETLare: ApacheSpark:ApacheSparkisafastandgeneral-purposeclustercomputingsystemthatincludessupportforETLtasksthroughitsSparkSQLandDataFrameAPIs.It'sparticularlyusefulforhandlinglarge-scaledataprocessingandisoftenusedinbigdataenvironments. ApacheAirflow:ApacheAirflowisaplatformforprogrammaticallyauthoring,scheduling,andmonitoringworkflows.ItallowsyoutodefinecomplexETLp...[阅读全文]
阅读 () ┆ 评论 (0)
GIT Flow s实践策略
(2024-04-16 14:19:23)
IntheGitflowworkflow,thereareseveralmainbranches:1.**Masterbranch**:Thisbranchrepresentsthestable,production-readycode.Itshouldideallyonlycontaincodethathasbeenthoroughlytestedandapprovedforrelease.2.**Developbranch**:Thedevelopbranchiswhereongoingdevelopmentworkoccurs.It'susedasastagingareaforfeaturesandbugfixesbeforetheyaremergedintothemasterbranchforrelease.3.**Featurebranches**:Featurebran...[阅读全文]
阅读 () ┆ 评论 (0)
[上一页]
[1]
[2]
[3]
[4]
[5]
[下一页]
[>>]
[首页]
[尾页]