oracle goldengate实现远程抽取postgresql 到 postgresql的实时同步【绝对无坑版，亲测流程验证】

oracle goldengate实现postgresql 到 postgresql的实时同步

源端：postgresql1 -> postgresql2 流复制主备同步
目标端：postgresql
数据库版本：postgresql 12.14
ogg版本：21.3

架构图：
在这里插入图片描述

数据库安装以及流复制主备同步配置忽略。以下直接进入OGG的配置

OGG服务器环境变量配置

export 
export OGG_HOME=/ogg213
export ODBCINI=/etc/odbc.ini
export ODBCSYSINI=/etc
LD_LIBRARY_PATH=/ogg213/lib:/pgdb/psql/lib:/lib64:/usr/lib64:/usr/local/lib64:/lib:/usr/lib:/usr/local/lib:$LD_LIBRARY_PATH

odbc配置：


[root@oradb1 ogg213]# yum list |grep postgresql-odbc.x86_64
Repodata is over 2 weeks old. Install yum-cron? Or run: yum makecache fast
postgresql-odbc.x86_64                  09.03.0100-2.el7               @centos7 
[root@oradb1 ogg213]# 

[root@oradb1 ogg213]# cat /etc/odbcinst.ini 
# Example driver definitions# Driver from the postgresql-odbc package
# Setup from the unixODBC package
[PostgreSQL]
Description	= ODBC for PostgreSQL
Driver		= /usr/lib64/psqlodbcw.so
Setup		= /usr/lib64/libodbcpsqlS.so
Driver64	= /usr/lib64/psqlodbcw.so
Setup64		= /usr/lib64/libodbcpsqlS.so
FileUsage	= 1# Driver from the mysql-connector-odbc package
# Setup from the unixODBC package
[MySQL]
Description	= ODBC for MySQL
Driver		= /usr/lib/libmyodbc5.so
Setup		= /usr/lib/libodbcmyS.so
Driver64	= /usr/lib64/libmyodbc5.so
Setup64		= /usr/lib64/libodbcmyS.so
FileUsage	= 1
[root@oradb1 ogg213]# cat /etc/odbc.ini 
#Sample DSN entries
[ODBC Data Sources]
PG_src=DataDirect 12.14 PostgreSQL Wire Protocol
PG_tgt=DataDirect 12.14 PostgreSQL Wire Protocol[ODBC]
IANAAppCodePage=4
InstallDir=/ogg213[pg_src1]
Driver=/ogg213/lib/GGpsql25.so
Description=DataDirect 12.14 PostgreSQL Wire Protocol
Database=testdb
HostName=192.168.56.11
PortNumber=5432
LogonID=ggadmin
Password=Bai_yun123
TransactionErrorBehavior=2[pg_src]
Driver=/ogg213/lib/GGpsql25.so
Description=DataDirect 12.14 PostgreSQL Wire Protocol
Database=testdb
HostName=192.168.56.12
PortNumber=5432
LogonID=ggadmin
Password=Bai_yun123
TransactionErrorBehavior=2[pg_tgt]
Driver=/ogg213/lib/GGpsql25.so
Description=DataDirect 12.14 PostgreSQL Wire Protocol
Database=testdb
HostName=192.168.56.101
PortNumber=5432
LogonID=ggadmin
Password=Bai_yun123
TransactionErrorBehavior=2
[root@oradb1 ogg213]#

OGG解压：

[root@oradb1 soft]# cd oggsoft/
[root@oradb1 oggsoft]# ll
total 467684
-rwxrwxr-x 1 postgres postgres  97040905 May 30 16:04 213000_ggs_Linux_x64_PostgreSQL_64bit.zip
-rw-rw-rw- 1 postgres postgres 381552640 Aug  5  2021 ggs_Linux_x64_PostgreSQL_64bit.tar
-rw-r--r-- 1 postgres postgres      2409 Aug 11  2021 OGG-21.3.0.0-README.txt
-rw-r--r-- 1 postgres postgres    306395 Aug 11  2021 oracle-goldengate-release-notes_21.3.pdf
[root@oradb1 oggsoft]# $ tar -xvf ggs_Linux_x64_PostgreSQL_64bit.tar -C /ogg213$ cd /ogg213
$ ./ggsci
$ create subdirs

MGR进程配置

GGSCI (oggser) 2> view param mgrPORT 7810
DYNAMICPORTLIST 7810-7820
AUTORESTART EXTRACT *, WAITMINUTES 2, RESETMINUTES 5
PURGEOLDEXTRACTS ./DIRDAT/*, USECHECKPOINTS,MINKEEPHOURS 24
AUTORESTART ER *, RETRIES 3, WAITMINUTES 2,RESETMINUTES 10
ACCESSRULE, PROG *, IPADDR 192.168.56.*, ALLOW

测试验证登录数据库成功：


GGSCI (oradb1) 6> dblogin sourcedb pg_src userid ggadmin password Bai_yun1232025-05-30 21:45:31  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-30 21:45:31  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oradb1 as ggadmin@pg_src) 7> dblogin sourcedb pg_tgt userid ggadmin password Bai_yun1232025-05-30 21:45:38  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-30 21:45:38  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oradb1 as ggadmin@pg_tgt) 8>

注册抽取进程

链接到备库注册抽取进程，失败。

GGSCI (oradb1 as ggadmin@pg_src) 9> register extract ep12025-05-30 21:47:59  WARNING OGG-00552  Database operation failed: Executing statement to create replication slot. Called from PGUTIL_registerExtract:178. ODBC error: SQLSTATE S1C00 native database error 466560. [Oracle][ODBC PostgreSQL Wire Protocol driver][PostgreSQL]ERROR: VERROR; logical decoding cannot be used while in recovery(File logical.c; Line 113; Routine CheckLogicalDecodingRequirements;.

链接到主库注册抽取进程，成功。

GGSCI (oradb1 as ggadmin@pg_src) 10> dblogin sourcedb pg_src1 userid ggadmin password Bai_yun1232025-05-30 21:52:04  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-30 21:52:04  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oggser as ggadmin@pg_src1) 10> register extract ep12025-05-31 11:34:52  INFO    OGG-25353  The replication slot 'ep1_831e5a3f6113dbb2' for group 'EP1' already exist in the database 'testdb'.GGSCI (oggser as ggadmin@pg_src1) 11> UNREGISTER EXTRACT ep1 with DATABASE testdb   ----->>> 删除之前增加的2025-05-31 11:36:30  INFO    OGG-25356  Successfully dropped the replication slot 'ep1_831e5a3f6113dbb2' for Extract group 'EP1' in database 'testdb'.GGSCI (oggser as ggadmin@pg_src1) 12> register extract ep12025-05-31 11:36:37  INFO    OGG-25355  Successfully created replication slot 'ep1_831e5a3f6113dbb2' for Extract group 'EP1' in database 'testdb'.

在数据库查看复制曹信息

testdb=# SELECT * FROM pg_stat_replication;

在这里插入图片描述

GGSCI (oradb1 as ggadmin@pg_src1) 12> edit param ep1
# 配置抽取进程参数GGSCI (oradb1 as ggadmin@pg_src1) 13> view param ep1extract ep1
setenv(PGCLIENTENCODING = "UTF8")
setenv(ODBCINI="/etc/odbc.ini" )
sourcedb testdb, userid ggadmin, password Bai_yun123
exttrail ./dirdat/e1
discardfile ./dirrpt/ep1.dsc
table public.tab1;

添加trandata

GGSCI (oggser as ggadmin@pg_src1) 2> ADD TRANDATA public.tab1Logging of supplemental log data is already enabled for table public.tab1 with REPLICA IDENTITY set to DEFAULT

启动抽取进程失败：

2025-05-30 22:13:22  ERROR   OGG-00551  Database operation failed: Couldn't connect to testdb. ODBC error: SQLSTATE IM002 native database error 0. [DataDirect][ODBC lib] D
ata source name not found and no default driver specified.2025-05-30 22:13:22  ERROR   OGG-01668  PROCESS ABENDING.

修改后再次启动
sourcedb pg_src1, userid ggadmin, password Bai_yun123


2025-05-30 22:16:24  ERROR   OGG-25516  Oracle GoldenGate capture using LIBPQ client library version as 90,401 which is incompatible with the connected PostgreSQL server v
ersion 121,400 for streaming the log record. The LIBPQ client library version must be the same as or bigger than, that of the connected PostgreSQL server library version.Source Context :SourceModule            : [ggvam.gen]SourceID                : [../gglib/ggvam/cvamgen.cpp]SourceMethod            : [vamInitialize]SourceLine              : [536]ThreadBacktrace         : [14] elements: [/ogg213/libgglog.so(CMessageContext::AddThreadContext())]: [/ogg213/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigned int, ...))]: [/ogg213/libgglog.so(_MSG_String_Int32(CSourceContext*, int, char const*, int, CMessageFactory::MessageDisposition))]: [/ogg213/extract(com_goldengate_vam::CVamGen::vamInitialize())]: [/ogg213/extract()]: [/ogg213/extract(ggs::er::VAMDataSource::finalizeConfiguration())]: [/ogg213/extract(ggs::gglib::ggapp::ReplicationContext::finalizeConfiguration())]: [/ogg213/extract()]: [/ogg213/extract(ggs::gglib::MultiThreading::MainThread::ExecMain())]: [/ogg213/extract(ggs::gglib::MultiThreading::Thread::RunThread(ggs::gglib::MultiThreading::Thread::ThreadArgs*))]: [/ogg213/extract(ggs::gglib::MultiThreading::MainThread::Run(int, char**))]: [/ogg213/extract(main)]: [/lib64/libc.so.6(__libc_start_main)]: [/ogg213/extract()]2025-05-30 22:16:24  ERROR   OGG-00145  Call to VAMInitialize returned with error status 16002.2025-05-30 22:16:24  ERROR   OGG-01668  PROCESS ABENDING.

根据提示的版本LIBPG的版本号与postgresql的版本号不一致导致。查看postgresql lib的安装包。

[root@oggser soft]# rpm -ivh postgresql12-libs-12.21-1PGDG.rhel7.x86_64.rpm 
warning: postgresql12-libs-12.21-1PGDG.rhel7.x86_64.rpm: Header V4 RSA/SHA1 Signature, key ID 73e3b907: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...1:postgresql12-libs-12.21-1PGDG.rhe################################# [100%][root@oggser ogg213]# yum list |grep postgres
postgresql-libs.x86_64                 9.2.24-1.el7_5              @local         
postgresql12-libs.x86_64               12.21-1PGDG.rhel7           installed

重新启动ep1进程，问题仍然出现。

尝试卸载

[root@oggser ogg213]# rpm -qa |grep postgresql-libs
postgresql-libs-9.2.24-1.el7_5.x86_64
[root@oggser ogg213]# rpm -e postgresql-libs-9.2.24-1.el7_5.x86_64
[root@oggser ogg213]# rpm -qa |grep postgresql-libs

再次重启ep1进程，正常。

GGSCI (oggser) 3> start ep1Sending START request to Manager ...
Extract group EP1 starting.GGSCI (oggser) 4> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     RUNNING     EP1         00:42:22      00:00:01    GGSCI (oggser) 9> info ep1Extract    EP1       Last Started 2025-05-31 12:19   Status RUNNING
Checkpoint Lag       00:00:00 (updated 00:00:05 ago)
Process ID           4427
VAM Read Checkpoint  2025-05-31 11:37:21.985039Replication Slot     Unavailable(requires DBLOGIN)
Slot Restart LSN     Unavailable(requires DBLOGIN)
Slot Flush LSN       Unavailable(requires DBLOGIN)
Current Log Position Unavailable(requires DBLOGIN)GGSCI (oggser) 10> stop ep1Sending STOP request to Extract group EP1 ...
Request processed.

查看进程状态的提示需要登录，尝试先登录数据库再启动。

GGSCI (oggser) 12> dblogin sourcedb pg_src1 userid ggadmin password Bai_yun1232025-05-31 12:42:07  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-31 12:42:07  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oggser as ggadmin@pg_src1) 13> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     STOPPED     EP1         00:00:00      00:21:55    GGSCI (oggser as ggadmin@pg_src1) 14> start ep1Sending START request to Manager ...
Extract group EP1 starting.GGSCI (oggser as ggadmin@pg_src1) 15> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     RUNNING     EP1         00:00:00      00:00:01    GGSCI (oggser as ggadmin@pg_src1) 16> info ep1Extract    EP1       Last Started 2025-05-31 12:42   Status RUNNING
Checkpoint Lag       00:00:00 (updated 00:00:05 ago)
Process ID           13486
VAM Read Checkpoint  2025-05-31 11:37:21.985039Replication Slot     ep1_831e5a3f6113dbb2 is active with PID 1900 in database testdb
Slot Restart LSN     0/301BE30
Slot Flush LSN       0/301BE68
Current Log Position 0/301BE68GGSCI (oggser as ggadmin@pg_src1) 17>

至此抽取进去配置完成。

添加应用进程

添加检查点表

GGSCI (oggser as ggadmin@pg_src1) 19> dblogin sourcedb pg_tgt, userid ggadmin, password Bai_yun1232025-05-31 12:53:51  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-31 12:53:51  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oggser as ggadmin@pg_tgt) 20> ADD CHECKPOINTTABLE ggadmin.oggcheck2025-05-31 12:54:06  WARNING OGG-30055  Database error 5738688 ([Oracle][ODBC PostgreSQL Wire Protocol driver][PostgreSQL]ERROR: VERROR; schema "ggadmin" does not exist(Position 14; File namespace.c; Line 3045; Routine get_namespace_oid; )).
Error: Failed creating checkpoint table ggadmin.oggcheck.<NIL>GGSCI (oggser as ggadmin@pg_tgt) 21> ADD CHECKPOINTTABLE public.oggcheckSuccessfully created checkpoint table public.oggcheck.

配置应用进程参数


edit param rp1 replicat rp1
setenv(PGCLIENTENCODING = "UTF8")
setenv(ODBCINI="/etc/odbc.ini" )
targetdb pg_tgt, userid ggadmin, password Bai_yun123
map public.tab1, public.tab1;GGSCI (oggser as ggadmin@pg_tgt) 23> ADD REPLICAT rp1, EXTTRAIL ./dirdat/e1, CHECKPOINTTABLE public.oggcheck
Replicat added.

启动应用进程失败


2025-05-31 12:57:24  INFO    OGG-03037  Session character set identified as UTF-8.
map public.tab1, public.tab1;Source Context :SourceModule            : [er.wildcard]SourceID                : [er/wildcard.c]SourceMethod            : [WILDCARD_get_entry]SourceLine              : [2658]ThreadBacktrace         : [12] elements: [/ogg213/libgglog.so(CMessageContext::AddThreadContext())]: [/ogg213/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigned int, ...))]: [/ogg213/libgglog.so(_MSG_String(CSourceContext*, int, char const*, CMessageFactory::MessageDisposition))]: [/ogg213/replicat(WILDCARD_get_entry(ggs::gglib::ggunicode::UString const&, recopts_t*, bool, bool, unsigned int*, void*, int, int, bool&, catalogList&, bool, bool, bool))]: [/ogg213/replicat(get_infile_params(ggs::gglib::ggapp::ReplicationContextParams&, ggs::gglib::ggdatasource::DataSourceParams&, ggs::gglib::ggdatatarget::DataTargetParams&, ggs::ggli
b::ggmetadata::MetadataContext&))]: [/ogg213/replicat()]: [/ogg213/replicat(ggs::gglib::MultiThreading::MainThread::ExecMain())]: [/ogg213/replicat(ggs::gglib::MultiThreading::Thread::RunThread(ggs::gglib::MultiThreading::Thread::ThreadArgs*))]: [/ogg213/replicat(ggs::gglib::MultiThreading::MainThread::Run(int, char**))]: [/ogg213/replicat(main)]: [/lib64/libc.so.6(__libc_start_main)]: [/ogg213/replicat()]2025-05-31 12:57:24  ERROR   OGG-00204  Missing TARGET specification.2025-05-31 12:57:24  ERROR   OGG-01668  PROCESS ABENDING.

原因：
参数配置中缺少target 关键字。
map public.tab1, target public.tab1;

修复后再次启动正常。

GGSCI (oggser as ggadmin@pg_tgt) 35> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     RUNNING     EP1         00:00:00      00:00:00    
REPLICAT    RUNNING     RP1         00:00:00      00:00:05

查看抽取进程和应用进程信息

GGSCI (oggser as ggadmin@pg_tgt) 39> info ep1Extract    EP1       Last Started 2025-05-31 12:42   Status RUNNING
Checkpoint Lag       00:00:00 (updated 00:00:11 ago)
Process ID           13486
VAM Read Checkpoint  2025-05-31 11:37:21.985039Replication Slot     Unavailable(requires DBLOGIN)
Slot Restart LSN     Unavailable(requires DBLOGIN)
Slot Flush LSN       Unavailable(requires DBLOGIN)
Current Log Position Unavailable(requires DBLOGIN)GGSCI (oggser as ggadmin@pg_tgt) 40> dblogin sourcedb pg_src1, userid ggadmin, password Bai_yun1232025-05-31 13:04:43  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-31 13:04:43  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oggser as ggadmin@pg_src1) 41> info ep1Extract    EP1       Last Started 2025-05-31 12:42   Status RUNNING
Checkpoint Lag       00:00:00 (updated 00:00:03 ago)
Process ID           13486
VAM Read Checkpoint  2025-05-31 11:37:21.985039Replication Slot     ep1_831e5a3f6113dbb2 is active with PID 1900 in database testdb
Slot Restart LSN     0/301BE30
Slot Flush LSN       0/301BE68
Current Log Position 0/301BE68

数据初始化进程配置

初始化抽取进程

dblogin sourcedb pg_src1, userid ggadmin, password Bai_yun123add ext ie1, sourceistable
edit param ie1
--添加如下内容
extract ie1
setenv(PGCLIENTENCODING = "UTF8")
setenv(ODBCINI="/etc/odbc.ini" )
sourcedb pg_src1, userid ggadmin, password Bai_yun123
extfile ./dirdat/i1
table public.tab1;--启动存量数据抽取
start ie1
info ie1

初始化应用进程

add rep ir1, exttrail ./dirdat/i1, nodbcheckpoint
edit param ir1
--添加如下内容replicat ir1
setenv(PGCLIENTENCODING = "UTF8")
setenv(ODBCINI="/etc/odbc.ini" )
targetdb pg_tgt, userid ggadmin, password Bai_yun123
discardfile ./dirrpt/ir11.dsc
map public.tab1, target public.tab1;--启动ir1进程
start ir1
info ir1

查看初始化信息

GGSCI (oggser as ggadmin@pg_src1) 50> info ir1Replicat   IR1       Last Started 2025-05-31 13:10   Status RUNNING
Checkpoint Lag       00:01:45 (updated 00:00:03 ago)
Process ID           14884
Log Read Checkpoint  File ./dirdat/i10000002025-05-31 13:08:25.380705  RBA 1781GGSCI (oggser as ggadmin@pg_src1) 51> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     RUNNING     EP1         00:00:00      00:00:07    
REPLICAT    RUNNING     IR1         00:01:45      00:00:07    
REPLICAT    RUNNING     RP1         00:00:00      00:00:05    GGSCI (oggser as ggadmin@pg_src1) 52> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     RUNNING     EP1         00:00:00      00:00:00    
REPLICAT    RUNNING     IR1         00:00:00      00:00:02    
REPLICAT    RUNNING     RP1         00:00:00      00:00:00    GGSCI (oggser as ggadmin@pg_src1) 53> stats ir1, totalSending STATS request to Replicat group IR1 ...Start of statistics at 2025-05-31 13:10:45.Replicating from public.tab1 to public.tab1:*** Total statistics since 2025-05-31 13:10:11 ***Total inserts                              1.00Total updates                              0.00Total deletes                              0.00Total upserts                              0.00Total discards                             0.00Total operations                           1.00End of statistics.GGSCI (oggser as ggadmin@pg_src1) 54> GGSCI (oggser as ggadmin@pg_src1) 46> info ie1Extract    IE1       Last Started 2025-05-31 13:08   Status STOPPED
Checkpoint Lag       Not Available
Log Read Checkpoint  Table public.tab12025-05-31 13:08:25  Record 1
Task                 SOURCEISTABLE

目标端查看数据已经初始化完成。

DML测试验证

源端主库插入变更。

testdb=# insert into tab1 values(2,'pg2');
INSERT 0 1
testdb=# 
testdb=# insert into tab1 values(3,'pg3');
INSERT 0 1
testdb=# insert into tab1 values(4,'pg4');
INSERT 0 1
testdb=# update tab1 set tname='pgbak' where tid=1;
UPDATE 1
testdb=# delete from tab1 where tid=2;
DELETE 1

OGG服务器查看进程统计信息

GGSCI (oggser as ggadmin@pg_src1) 57> stats ep1 ,totalSending STATS request to Extract group EP1 ...Start of statistics at 2025-05-31 13:16:46.Output to ./dirdat/e1:Extracting from public.tab1 to public.tab1:*** Total statistics since 2025-05-31 13:15:08 ***Total inserts                              3.00Total updates                              1.00Total deletes                              1.00Total upserts                              0.00Total discards                             0.00Total operations                           5.00End of statistics.GGSCI (oggser as ggadmin@pg_src1) 58> stats rp1 ,totalSending STATS request to Replicat group RP1 ...Start of statistics at 2025-05-31 13:16:55.Replicating from public.tab1 to public.tab1:*** Total statistics since 2025-05-31 13:15:12 ***Total inserts                              3.00Total updates                              1.00Total deletes                              1.00Total upserts                              0.00Total discards                             0.00Total operations                           5.00End of statistics.GGSCI (oggser as ggadmin@pg_src1) 59>

在这里插入图片描述

参考文档：
https://docs.oracle.com/en/middleware/goldengate/core/19.1/oggmp/oracle-goldengate-classic-postgresql-server.html#GUID-15DF455B-2C8D-48B4-9158-FF4A93ACBCD8
https://docs.oracle.com/en/middleware/goldengate/core/19.1/oggmp/oracle-goldengate-classic-postgresql-server.html#GUID-98D9FC8A-D0C7-4C1B-9D5A-20CF559BC302

本文来自互联网用户投稿，该文观点仅代表作者本人，不代表本站立场。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如若转载，请注明出处：http://www.pswp.cn/diannao/85209.shtml

如若内容造成侵权/违法违规/事实不符，请联系多彩编程网进行投诉反馈email:809451989@qq.com，一经查实，立即删除！

相关文章

2.从0开始搭建vue项目（node.js，vue3，Ts，ES6）

2.从0开始搭建vue项目（node.js，vue3，Ts，ES6）

从“0到跑起来一个 Vue 项目”&#xff0c;重点是各个工具之间的关联关系、职责边界和技术演化脉络。 从你写代码 → 到代码能跑起来 → 再到代码可以部署上线&#xff0c;每一步都有不同的工具参与。 &#x1f63a;&#x1f63a;1. 安装 Node.js —— 万事的根基 Node.js 是…
阅读更多...
MQTT的Thingsboards的使用

MQTT的Thingsboards的使用

访问云服务 https://thingsboard.cloud/ 新建一个设备 弹出 默认是mosquittor的客户端。 curl -v -X POST http://thingsboard.cloud/api/v1/tnPrO76AxF3TAyOblf9x/telemetry --header Content-Type:application/json --data "{temperature:25}" 换成MQTTX的客户…
阅读更多...
金砖国家人工智能高级别论坛在巴西召开，华院计算应邀出席并发表主题演讲

金砖国家人工智能高级别论坛在巴西召开，华院计算应邀出席并发表主题演讲

当地时间5月20日&#xff0c;由中华人民共和国工业和信息化部&#xff0c;巴西发展、工业、贸易与服务部&#xff0c;巴西公共服务管理和创新部以及巴西科技创新部联合举办的金砖国家人工智能高级别论坛&#xff0c;在巴西首都巴西利亚举行。 中华人民共和国工业和信息化部副部…
阅读更多...
BLE协议全景图：从0开始理解低功耗蓝牙

BLE协议全景图：从0开始理解低功耗蓝牙

BLE（Bluetooth Low Energy）作为一种针对低功耗场景优化的通信协议，已经广泛应用于智能穿戴、工业追踪、智能家居、医疗设备等领域。 本文是《BLE 协议实战详解》系列的第一篇，将从 BLE 的发展历史、协议栈结构、核心机制和应用领域出发，为后续工程实战打下全面认知基础。 …
阅读更多...
表单校验代码和树形结构值传递错误解决

表单校验代码和树形结构值传递错误解决

表单校验代码&#xff0c;两种方式校验&#xff0c;自定义的一种校验&#xff0c;与element-ui组件原始的el-form表单的校验不一样&#xff0c;需要传递props和rules过去校验 const nextStep () > {const data taskMsgInstance.value.formDataif(data.upGradeOrg ) {elm…
阅读更多...
vscode 配置 QtCreat Cmake项目

vscode 配置 QtCreat Cmake项目

1.vscode安装CmakeTool插件并配置QT中cmake的路径&#xff0c;不止这一处 2.cmake生成器使用Ninja&#xff08;Ninja在安装QT时需要勾选&#xff09;&#xff0c;可以解决[build] cc1plus.exe: error: too many filenames given; type ‘cc1plus.exe --help’ for usage 编译时…
阅读更多...
关于数据仓库、数据湖、数据平台、数据中台和湖仓一体的概念和区别

关于数据仓库、数据湖、数据平台、数据中台和湖仓一体的概念和区别

我们谈论数据中台之前&#xff0c; 我们也听到过数据平台、数据仓库、数据湖、湖仓一体的相关概念&#xff0c;它们都与数据有关系&#xff0c;但他们和数据中台有什么样的区别&#xff0c; 下面我们将围绕数据平台、数据仓库、数据湖和数据中台的区别进行介绍。 一、相关概念…
阅读更多...
WIN11+eclipse搭建java开发环境

WIN11+eclipse搭建java开发环境

环境搭建&#xff08;WIN11ECLIPSE&#xff09; 安装JAVA JDK https://www.oracle.com/cn/java/technologies/downloads/#jdk24安装eclipse https://www.eclipse.org/downloads/ 注意&#xff1a;eclipse下载时指定aliyun的软件源&#xff0c;后面安装会快一些。默认是jp汉化e…
阅读更多...
通义灵码深度实战测评：从零构建智能家居控制中枢，体验AI编程新范式

通义灵码深度实战测评：从零构建智能家居控制中枢，体验AI编程新范式

一、项目背景&#xff1a;零基础挑战全栈智能家居系统 目标&#xff1a;开发具备设备控制、环境感知、用户习惯学习的智能家居控制中枢&#xff08;PythonFlaskMQTTReact&#xff09; 挑战点&#xff1a; 需集成硬件通信(MQTT)、Web服务(Flask)、前端交互(React) 调用天气AP…
阅读更多...
【Python进阶】CPython

【Python进阶】CPython

目录 🌟 前言🏗️ 技术背景与价值🩹 当前技术痛点🛠️ 解决方案概述👥 目标读者说明🧠 一、技术原理剖析📊 核心架构图解💡 核心作用讲解🔧 关键技术模块说明⚖️ Python实现对比🛠️ 二、实战演示⚙️ 环境配置要求💻 核心代码实现案例1：查看字节码案例…
阅读更多...
Hive中资源优化方法的详细说明

Hive中资源优化方法的详细说明

在Hive中&#xff0c;资源优化的核心目标是合理分配集群资源&#xff08;如内存、CPU、任务并行度等&#xff09;&#xff0c;避免资源竞争和浪费&#xff0c;提升查询效率。以下是资源优化的具体方法&#xff0c;涵盖 YARN资源配置、任务并行度、内存管理、JVM重用、推测执行 …
阅读更多...
流媒体协议分析：流媒体传输的基石

流媒体协议分析：流媒体传输的基石

在流媒体传输过程中&#xff0c;协议的选择至关重要&#xff0c;它决定了数据如何封装、传输和解析&#xff0c;直接影响着视频的播放质量和用户体验。本文将深入分析几种常见的流媒体传输协议&#xff0c;探讨它们的特点、应用场景及优缺点。 协议分类概述 流媒体传输协议根据…
阅读更多...
GitHub 趋势日报 (2025年05月29日)

GitHub 趋势日报 (2025年05月29日)

&#x1f4ca; 由 TrendForge 系统生成 | &#x1f310; https://trendforge.devlive.org/ &#x1f310; 本日报中的项目描述已自动翻译为中文 &#x1f4c8; 今日获星趋势图 今日获星趋势图 1864 agenticSeek 753 langflow 749 n8n 736 prompt-eng-interactive-tutorial 42…
阅读更多...
Jenkins-Pipeline：学习笔记

Jenkins-Pipeline：学习笔记

Jenkins-Pipeline：学习笔记 在 DevOps 领域中，Pipeline（流水线） 是实现持续集成（CI）和持续部署（CD）的核心机制。学习 Pipeline 通常需要从以下几个方面入手，涵盖基础概念、工具使用、语法规则、实践优化等 一、Pipeline 基础概念 什么是 Pipeline？ 流水线是将软件交…
阅读更多...
内存管理 ： 04段页结合的实际内存管理

内存管理 ： 04段页结合的实际内存管理

一、课程核心主题引入 这一讲&#xff0c;我要给大家讲的是真正的内存管理&#xff0c;也就是段和页结合在一起的内存管理方式。之前提到过&#xff0c;我们先学习了分段管理内存的工作原理&#xff0c;知道操作系统采用分段的方式&#xff0c;让用户程序能以分段的结构进行编…
阅读更多...
RAID磁盘阵列配置

RAID磁盘阵列配置

RAID磁盘阵列配置 文章目录 RAID磁盘阵列配置一、磁盘管理其他相关命令1.fsck-检查文件的正确性2.dd-建立和使用交换文件3.mkswap-建立和设置SWAP交换分区 二、RAID配置 一、磁盘管理其他相关命令 1.fsck-检查文件的正确性 [rootlocalhost ~]# fsck -aC /dev/sda1 //检查文…
阅读更多...
网站服务器出现异常的原因是什么？

网站服务器出现异常的原因是什么？

网站时企业和个人用户进行提供信息和服务的重要平台&#xff0c;随着时间的推移&#xff0c;网站服务器出现异常情况也是常见的问题之一&#xff0c;这可能会导致网站无法正常访问或者是运行缓慢&#xff0c;会严重影响到用户的体验感&#xff0c;本文就来介绍一下网站服务器出…
阅读更多...
LINUX528 重定向

LINUX528 重定向

2>&1 我的理解&#xff1a; 2>&1&#xff0c;2stderr错误输出&#xff0c;1stdout输出&#xff0c;stderr一般和stdout是分别输出&#xff08;管道符只传递stdout&#xff0c;据元宝&#xff0c;stderr默认输出到终端&#xff1b;如果重定向符不进行2显示重定向&…
阅读更多...
【Python高阶】面向对象

【Python高阶】面向对象

目录 🌟 前言🏗️ 技术背景与价值🩹 当前技术痛点🛠️ 解决方案概述👥 目标读者说明🧠 一、技术原理剖析📊 核心知识图谱💡 核心作用讲解🔧 关键技术模块说明⚖️ 技术选型对比🛠️ 二、实战演示⚙️ 环境配置要求💻 核心代码实现案例1：面向对象电商系统…
阅读更多...
榕壹云医疗服务系统：基于ThinkPHP+MySQL+UniApp的多门店医疗预约小程序解决方案

榕壹云医疗服务系统：基于ThinkPHP+MySQL+UniApp的多门店医疗预约小程序解决方案

在数字化浪潮下，传统医疗服务行业正面临效率提升与客户体验优化的双重挑战。针对口腔、美容、诊所、中医馆、专科医院及康复护理等需要预约或诊断服务的行业，我们开发了一款基于ThinkPHP+MySQL+UniApp的多门店服务预约小程序——榕壹云医疗服务系统。该系统通过模块化设计与开…
阅读更多...
最新文章

Copyright @ 2022~2023