Ceph/Manager をテンプレートにして作成
[
トップ
] [
新規
|
一覧
|
検索
|
最終更新
|
ヘルプ
|
ログイン
]
開始行:
''CephFS Manager''
[[https://ceph.readthedocs.io/en/latest/start/intro/>+htt...
#code(nonumber){{
Managers: A Ceph Manager daemon (ceph-mgr) is responsible...
including storage utilization, current performance metric...
The Ceph Manager daemons also host python-based modules t...
At least two managers are normally required for high avai...
(deepL先生翻訳)
マネージャ： Ceph Managerデーモン(ceph-mgr)は、ランタイム...
ストレージ使用率、現在のパフォーマンスメトリクス、システ...
Ceph Managerデーモンは、WebベースのCeph DashboardおよびRE...
通常、高可用性を実現するには少なくとも2つのマネージャが必...
}}
ストレージの容量、パフォーマンス、負荷らの監視かな.
こちらも「At least two managers are normally required for...
参照先[[https://docs.ceph.com/en/latest/mgr/administrator...
ここでは CephFS Monitors を持つceph01とceph02に担当させま...
***Managerの構築(その１) [#g7aefe80]
リポジトリの登録は既にMonitor構築で済んでいるので Manager...
#code(nonumber){{
[root@ceph01 ~]# dnf install ceph-mgr
}}
その後で構築を始めます
#code(nonumber){{
[root@ceph01 ~]# sudo -u ceph mkdir /var/lib/ceph/mgr/cep...
[root@ceph01 ~]# sudo -u ceph ceph auth get-or-create mgr...
(エラーの場合は「/etc/ceph/ceph.client.admin.keyring」の...
[root@ceph01 ~]# ls -l /var/lib/ceph/mgr/ceph-ceph01/
total 4
-rw-r--r--. 1 ceph ceph 61 Mar 3 01:54 keyring
[root@ceph01 ~]# cat /var/lib/ceph/mgr/ceph-ceph01/keyring
[mgr.ceph01]
key = AQBcjcRntzIfDRAAzmmnE5L+HVw/cfKjmdz8zw==
[root@ceph01 ~]#
}}
次はManagerの起動デーモンを調整します.
#code(nonumber){{
[root@ceph01 ~]# cat /usr/lib/systemd/system/ceph-mgr\@.s...
:
ExecStart=/usr/bin/ceph-mgr -f --cluster ${CLUSTER} --id ...
:
[root@ceph01 ~]#
}}
とあるので、
#code(nonumber){{
[root@ceph01 ~]# systemctl enable ceph-mgr@ceph01.service
Created symlink /etc/systemd/system/ceph-mgr.target.wants...
[root@ceph01 ~]# systemctl start ceph-mgr@ceph01.service
}}
firewallにManagerの穴をあけます
#code(nonumber){{
[root@ceph01 ~]# firewall-cmd --add-service=ceph --perman...
[root@ceph01 ~]# firewall-cmd --reload
}}
Managerの起動を確認します
#code(nonumber){{
[root@ceph01 ~]# ceph -s
cluster:
id: c2d06c20-9197-40b4-a8c4-1a0604936ce8
health: HEALTH_OK
services:
mon: 3 daemons, quorum ceph01,ceph02,ceph-osd1 (age 1...
mgr: ceph01(active, since 4s)
osd: 0 osds: 0 up, 0 in
data:
pools: 0 pools, 0 pgs
objects: 0 objects, 0 B
usage: 0 B used, 0 B / 0 B avail
pgs:
[root@ceph01 ~]#
}}
mgrが追加されました
***Managerの構築(その２) [#le7d0817]
っで ceph02 にも設けます
#code(nonumber){{
ssh ceph02
dnf install ceph-mgr -y
sudo -u ceph mkdir /var/lib/ceph/mgr/ceph-ceph02
sudo -u ceph ceph auth get-or-create mgr.ceph02 mon 'allo...
systemctl start ceph-mgr@ceph02.service --now
firewall-cmd --add-service=ceph --permanent
firewall-cmd --reload
}}
そうすると ceph -s の値は下記のようになります
#code(nonumber){{
[root@ceph01 ~]# ceph -s
:
services:
mon: 3 daemons, quorum ceph01,ceph02,ceph-osd1 (age 1...
mgr: ceph01(active, since 12m), standbys: ceph02
osd: 0 osds: 0 up, 0 i
:
[root@ceph01 ~]#
}}
***Dashboard [#s32386f2]
webベースの管理ツールです
dnfのパッケージからdashboardを入れるみたい. インストール...
#code(nonumber){{
[root@ceph01 ~]# dnf --enablerepo=devel install ceph-mgr-...
[root@ceph01 ~]# ceph mgr module ls
MODULE
:
dashboard - <-- これ
:
[root@ceph01 ~]#
[root@ceph01 ~]# ceph mgr module enable dashboard
Error ENOENT: all mgr daemons do not support module 'dash...
[root@ceph01 ~]# ceph mgr module enable dashboard --force...
(dashboardの設定)
[root@ceph01 ~]# ceph config ls | grep mgr/dashboard <--...
[root@ceph01 ~]# ceph config get mgr mgr/dashboard/ssl
true
[root@ceph01 ~]# ceph config set mgr mgr/dashboard/ssl fa...
[root@ceph01 ~]# ceph config get mgr mgr/dashboard/server...
::
[root@ceph01 ~]# ceph config get mgr mgr/dashboard/server...
8080
[root@ceph01 ~]# lsof -i -P | grep 8080
ceph-mgr 12581 ceph 44u IPv6 43943 0t0 TCP *...
[root@ceph01 ~]#
[root@ceph01 ~]# ceph dashboard get-pwd-policy-enabled
True
[root@ceph01 ~]# ceph dashboard set-pwd-policy-enabled fa...
[root@ceph01 ~]#
[root@ceph01 ~]# ceph dashboard ac-user-show ...
[]
[root@ceph01 ~]#
[root@ceph01 ~]# echo -n "adminpass" > password.txt ...
[root@ceph01 ~]# ceph dashboard ac-user-create admin -i p...
(dashboard内の設定方法一覧)
[root@ceph01 ~]# ceph dashboard -h
(8080のportに穴をあけます)
[root@ceph01 ~]# firewall-cmd --add-port=8080/tcp --zone=...
}}
PCからceph01の8080を見ます
&ref(2025y04m25d_012649834.png,nolink);
登録したアカウントとパスワードで認証を経ると下記画面にな...
&ref(2025y04m25d_012829018.png,nolink);
注目としては「Orchestrator」の値がないということ。これがc...
***クラッシュモジュール [#j99b7bc4]
#code(nonumber){{
[root@ceph01 ~]# ceph -s
cluster:
id: c2d06c20-9197-40b4-a8c4-1a0604936ce8
health: HEALTH_WARN
3 mgr modules have recently crashed
:
[root@ceph01 ~]#
}}
と表示された際、この「3 mgr modules have recently crashed...
#code(nonumber){{
[root@ceph01 ~]# ceph health detail
HEALTH_WARN 3 mgr modules have recently crashed
[WRN] RECENT_MGR_MODULE_CRASH: 3 mgr modules have recentl...
mgr module nfs crashed in daemon mgr.ceph01 on host c...
mgr module nfs crashed in daemon mgr.ceph01 on host c...
mgr module nfs crashed in daemon mgr.ceph01 on host c...
[root@ceph01 ~]#
}}
で詳しく見れて、
#code(nonumber){{
[root@ceph01 ~]# ceph crash ls
ID ...
2025-04-25T17:35:28.260872Z_cbcfe784-c3c9-4afd-81e6-bc090...
2025-04-25T17:50:49.181477Z_a12c9575-22f4-4282-bdc2-2fccd...
2025-04-25T17:50:54.661555Z_52105f1a-ba86-4a29-9133-df02b...
[root@ceph01 ~]#
}}
でも見れる.
ここで「ceph crash info <ID>」で詳細が見れる.
#code(nonumber){{
[root@ceph01 ~]# ceph crash info 2025-04-25T17:35:28.2608...
{
"backtrace": [
" File \"/usr/share/ceph/mgr/nfs/module.py\", li...
" File \"/usr/share/ceph/mgr/nfs/utils.py\", lin...
" File \"/usr/share/ceph/mgr/orchestrator/_inter...
" File \"/usr/share/ceph/mgr/orchestrator/_inter...
"orchestrator._interface.NoOrchestrator: No orche...
],
"ceph_version": "19.2.2",
"crash_id": "2025-04-25T17:35:28.260872Z_cbcfe784-c3c...
"entity_name": "mgr.ceph01",
"mgr_module": "nfs",
"mgr_module_caller": "ActivePyModule::dispatch_remote...
"mgr_python_exception": "NoOrchestrator",
"os_id": "rocky",
"os_name": "Rocky Linux",
"os_version": "9.4 (Blue Onyx)",
"os_version_id": "9.4",
"process_name": "ceph-mgr",
"stack_sig": "1199785675eabc11ce537d594914ffe3daad2e1...
"timestamp": "2025-04-25T17:35:28.260872Z",
"utsname_hostname": "ceph01",
"utsname_machine": "x86_64",
"utsname_release": "5.14.0-427.13.1.el9_4.x86_64",
"utsname_sysname": "Linux",
"utsname_version": "#1 SMP PREEMPT_DYNAMIC Wed May 1 ...
}
[root@ceph01 ~]#
}}
また、削除するには「ceph crash rm <ID>」とする
#code(nonumber){{
[root@ceph01 ~]# ceph crash rm 2025-04-25T17:35:28.260872...
[root@ceph01 ~]# ceph crash rm 2025-04-25T17:50:49.181477...
[root@ceph01 ~]# ceph crash rm 2025-04-25T17:50:54.661555...
[root@ceph01 ~]# ceph crash ls
}}
で消せる.
終了行:
''CephFS Manager''
[[https://ceph.readthedocs.io/en/latest/start/intro/>+htt...
#code(nonumber){{
Managers: A Ceph Manager daemon (ceph-mgr) is responsible...
including storage utilization, current performance metric...
The Ceph Manager daemons also host python-based modules t...
At least two managers are normally required for high avai...
(deepL先生翻訳)
マネージャ： Ceph Managerデーモン(ceph-mgr)は、ランタイム...
ストレージ使用率、現在のパフォーマンスメトリクス、システ...
Ceph Managerデーモンは、WebベースのCeph DashboardおよびRE...
通常、高可用性を実現するには少なくとも2つのマネージャが必...
}}
ストレージの容量、パフォーマンス、負荷らの監視かな.
こちらも「At least two managers are normally required for...
参照先[[https://docs.ceph.com/en/latest/mgr/administrator...
ここでは CephFS Monitors を持つceph01とceph02に担当させま...
***Managerの構築(その１) [#g7aefe80]
リポジトリの登録は既にMonitor構築で済んでいるので Manager...
#code(nonumber){{
[root@ceph01 ~]# dnf install ceph-mgr
}}
その後で構築を始めます
#code(nonumber){{
[root@ceph01 ~]# sudo -u ceph mkdir /var/lib/ceph/mgr/cep...
[root@ceph01 ~]# sudo -u ceph ceph auth get-or-create mgr...
(エラーの場合は「/etc/ceph/ceph.client.admin.keyring」の...
[root@ceph01 ~]# ls -l /var/lib/ceph/mgr/ceph-ceph01/
total 4
-rw-r--r--. 1 ceph ceph 61 Mar 3 01:54 keyring
[root@ceph01 ~]# cat /var/lib/ceph/mgr/ceph-ceph01/keyring
[mgr.ceph01]
key = AQBcjcRntzIfDRAAzmmnE5L+HVw/cfKjmdz8zw==
[root@ceph01 ~]#
}}
次はManagerの起動デーモンを調整します.
#code(nonumber){{
[root@ceph01 ~]# cat /usr/lib/systemd/system/ceph-mgr\@.s...
:
ExecStart=/usr/bin/ceph-mgr -f --cluster ${CLUSTER} --id ...
:
[root@ceph01 ~]#
}}
とあるので、
#code(nonumber){{
[root@ceph01 ~]# systemctl enable ceph-mgr@ceph01.service
Created symlink /etc/systemd/system/ceph-mgr.target.wants...
[root@ceph01 ~]# systemctl start ceph-mgr@ceph01.service
}}
firewallにManagerの穴をあけます
#code(nonumber){{
[root@ceph01 ~]# firewall-cmd --add-service=ceph --perman...
[root@ceph01 ~]# firewall-cmd --reload
}}
Managerの起動を確認します
#code(nonumber){{
[root@ceph01 ~]# ceph -s
cluster:
id: c2d06c20-9197-40b4-a8c4-1a0604936ce8
health: HEALTH_OK
services:
mon: 3 daemons, quorum ceph01,ceph02,ceph-osd1 (age 1...
mgr: ceph01(active, since 4s)
osd: 0 osds: 0 up, 0 in
data:
pools: 0 pools, 0 pgs
objects: 0 objects, 0 B
usage: 0 B used, 0 B / 0 B avail
pgs:
[root@ceph01 ~]#
}}
mgrが追加されました
***Managerの構築(その２) [#le7d0817]
っで ceph02 にも設けます
#code(nonumber){{
ssh ceph02
dnf install ceph-mgr -y
sudo -u ceph mkdir /var/lib/ceph/mgr/ceph-ceph02
sudo -u ceph ceph auth get-or-create mgr.ceph02 mon 'allo...
systemctl start ceph-mgr@ceph02.service --now
firewall-cmd --add-service=ceph --permanent
firewall-cmd --reload
}}
そうすると ceph -s の値は下記のようになります
#code(nonumber){{
[root@ceph01 ~]# ceph -s
:
services:
mon: 3 daemons, quorum ceph01,ceph02,ceph-osd1 (age 1...
mgr: ceph01(active, since 12m), standbys: ceph02
osd: 0 osds: 0 up, 0 i
:
[root@ceph01 ~]#
}}
***Dashboard [#s32386f2]
webベースの管理ツールです
dnfのパッケージからdashboardを入れるみたい. インストール...
#code(nonumber){{
[root@ceph01 ~]# dnf --enablerepo=devel install ceph-mgr-...
[root@ceph01 ~]# ceph mgr module ls
MODULE
:
dashboard - <-- これ
:
[root@ceph01 ~]#
[root@ceph01 ~]# ceph mgr module enable dashboard
Error ENOENT: all mgr daemons do not support module 'dash...
[root@ceph01 ~]# ceph mgr module enable dashboard --force...
(dashboardの設定)
[root@ceph01 ~]# ceph config ls | grep mgr/dashboard <--...
[root@ceph01 ~]# ceph config get mgr mgr/dashboard/ssl
true
[root@ceph01 ~]# ceph config set mgr mgr/dashboard/ssl fa...
[root@ceph01 ~]# ceph config get mgr mgr/dashboard/server...
::
[root@ceph01 ~]# ceph config get mgr mgr/dashboard/server...
8080
[root@ceph01 ~]# lsof -i -P | grep 8080
ceph-mgr 12581 ceph 44u IPv6 43943 0t0 TCP *...
[root@ceph01 ~]#
[root@ceph01 ~]# ceph dashboard get-pwd-policy-enabled
True
[root@ceph01 ~]# ceph dashboard set-pwd-policy-enabled fa...
[root@ceph01 ~]#
[root@ceph01 ~]# ceph dashboard ac-user-show ...
[]
[root@ceph01 ~]#
[root@ceph01 ~]# echo -n "adminpass" > password.txt ...
[root@ceph01 ~]# ceph dashboard ac-user-create admin -i p...
(dashboard内の設定方法一覧)
[root@ceph01 ~]# ceph dashboard -h
(8080のportに穴をあけます)
[root@ceph01 ~]# firewall-cmd --add-port=8080/tcp --zone=...
}}
PCからceph01の8080を見ます
&ref(2025y04m25d_012649834.png,nolink);
登録したアカウントとパスワードで認証を経ると下記画面にな...
&ref(2025y04m25d_012829018.png,nolink);
注目としては「Orchestrator」の値がないということ。これがc...
***クラッシュモジュール [#j99b7bc4]
#code(nonumber){{
[root@ceph01 ~]# ceph -s
cluster:
id: c2d06c20-9197-40b4-a8c4-1a0604936ce8
health: HEALTH_WARN
3 mgr modules have recently crashed
:
[root@ceph01 ~]#
}}
と表示された際、この「3 mgr modules have recently crashed...
#code(nonumber){{
[root@ceph01 ~]# ceph health detail
HEALTH_WARN 3 mgr modules have recently crashed
[WRN] RECENT_MGR_MODULE_CRASH: 3 mgr modules have recentl...
mgr module nfs crashed in daemon mgr.ceph01 on host c...
mgr module nfs crashed in daemon mgr.ceph01 on host c...
mgr module nfs crashed in daemon mgr.ceph01 on host c...
[root@ceph01 ~]#
}}
で詳しく見れて、
#code(nonumber){{
[root@ceph01 ~]# ceph crash ls
ID ...
2025-04-25T17:35:28.260872Z_cbcfe784-c3c9-4afd-81e6-bc090...
2025-04-25T17:50:49.181477Z_a12c9575-22f4-4282-bdc2-2fccd...
2025-04-25T17:50:54.661555Z_52105f1a-ba86-4a29-9133-df02b...
[root@ceph01 ~]#
}}
でも見れる.
ここで「ceph crash info <ID>」で詳細が見れる.
#code(nonumber){{
[root@ceph01 ~]# ceph crash info 2025-04-25T17:35:28.2608...
{
"backtrace": [
" File \"/usr/share/ceph/mgr/nfs/module.py\", li...
" File \"/usr/share/ceph/mgr/nfs/utils.py\", lin...
" File \"/usr/share/ceph/mgr/orchestrator/_inter...
" File \"/usr/share/ceph/mgr/orchestrator/_inter...
"orchestrator._interface.NoOrchestrator: No orche...
],
"ceph_version": "19.2.2",
"crash_id": "2025-04-25T17:35:28.260872Z_cbcfe784-c3c...
"entity_name": "mgr.ceph01",
"mgr_module": "nfs",
"mgr_module_caller": "ActivePyModule::dispatch_remote...
"mgr_python_exception": "NoOrchestrator",
"os_id": "rocky",
"os_name": "Rocky Linux",
"os_version": "9.4 (Blue Onyx)",
"os_version_id": "9.4",
"process_name": "ceph-mgr",
"stack_sig": "1199785675eabc11ce537d594914ffe3daad2e1...
"timestamp": "2025-04-25T17:35:28.260872Z",
"utsname_hostname": "ceph01",
"utsname_machine": "x86_64",
"utsname_release": "5.14.0-427.13.1.el9_4.x86_64",
"utsname_sysname": "Linux",
"utsname_version": "#1 SMP PREEMPT_DYNAMIC Wed May 1 ...
}
[root@ceph01 ~]#
}}
また、削除するには「ceph crash rm <ID>」とする
#code(nonumber){{
[root@ceph01 ~]# ceph crash rm 2025-04-25T17:35:28.260872...
[root@ceph01 ~]# ceph crash rm 2025-04-25T17:50:49.181477...
[root@ceph01 ~]# ceph crash rm 2025-04-25T17:50:54.661555...
[root@ceph01 ~]# ceph crash ls
}}
で消せる.
ページ名:
1
![[PukiWiki]](image/picc.png "[PukiWiki]")
