- Patent Number:
11930,266
- Appl. No:
17/845370
- Application Filed:
June 21, 2022
- نبذة مختصرة :
A line-of-sight detection apparatus includes a processor, and a memory storing a program which, when executed by the processor, causes the line-of-sight detection apparatus to function as a line-of-sight detection unit configured to detect a position of a line of sight of a user with respect to a display unit, a subject detection unit configured to detect a subject from an image displayed in the display unit, and a correction value determination unit configured to determine a correction value used by the line-of-sight detection unit such that the position of the line of sight detected by the line-of-sight detection unit matches a position of the subject detected by the subject detection unit.
- Inventors:
CANON KABUSHIKI KAISHA (Tokyo, JP)
- Assignees:
Canon Kabushiki Kaisha (Tokyo, JP)
- Claim:
1. A line-of-sight detection apparatus comprising: a processor; and a memory storing a program which, when executed by the processor, causes the line-of-sight detection apparatus to function as: a line-of-sight detection unit configured to detect a position of a line of sight of a user with respect to a display unit, a line-of-sight position correction unit configured to correct the position of the line of sight detected by the line-of-sight detection unit by using a correction value, a subject detection unit configured to detect a subject from an image displayed in the display unit, and a correction value determination unit configured to determine the correction value used by the line-of-sight position correction unit such that the position of the line of sight corrected by the line-of-sight position correction unit matches a position of the subject detected by the subject detection unit, wherein the correction value determination unit determines the correction value such that, in a case where a plurality of subjects are detected, the position of the line of sight corrected by the line-of-sight position correction unit matches a first subject of the plurality of subjects, and wherein the correction value determination unit determines the correction value such that, in a case where a degree of matching between the position of the line of sight corrected by the line-of-sight position correction unit and the first subject does not satisfy a predetermined condition, the position of the line of sight corrected by the line-of-sight position correction unit matches a subject which is different from the first subject, among the plurality of subjects.
- Claim:
2. The line-of-sight detection apparatus according to claim 1 , wherein the correction value determination unit determines the correction value such that, in a case where the plurality of subjects are detected, the first subject or the subject which is different from the first subject are present in a predetermined area in the image.
- Claim:
3. The line-of-sight detection apparatus according to claim 2 , wherein, in a case where a plurality of types of subjects are detected from the image, the correction value determination unit selects, according to information indicating which type of subject is prioritized, a subject corresponding to the type indicated by the information from among the plurality of subjects.
- Claim:
4. The line-of-sight detection apparatus according to claim 2 , wherein the correction value determination unit selects the first subject from among the plurality of subjects, based on information which specifies a subject used in determination of the correction value.
- Claim:
5. The line-of-sight detection apparatus according to claim 4 , wherein the correction value determination unit selects the subject which is determined, the position of the line of sight that is detected by the line-of-sight detection unit being a reference.
- Claim:
6. The line-of-sight detection apparatus according to claim 1 , wherein the correction value determination unit determines the correction value such that, after a lapse of a predetermined time period, in a case where the degree of matching between the position of the line of sight corrected by the line-of-sight position correction unit and the first subject is less than a predetermined threshold value, the position of the line of sight corrected by the line-of-sight position correction unit matches a subject which is different from the first subject, among the plurality of the subjects.
- Claim:
7. The line-of-sight detection apparatus according to claim 1 , wherein the subject detection unit detects a feature position of the detected subject, and the correction value determination unit determines the correction value such that the position of the line of sight corrected by the line-of-sight position correction unit matches the feature position.
- Claim:
8. The line-of-sight detection apparatus according to claim 7 , wherein the subject detection unit detects, in a case where the detected subject is a living thing, an organ of the subject, and detects a position of the detected organ as the feature position.
- Claim:
9. The line-of-sight detection apparatus according to claim 7 , wherein the subject detection unit detects the feature position according to a shape of a subject area of the detected subject.
- Claim:
10. The line-of-sight detection apparatus according to claim 9 , wherein the subject detection unit uses a geometric gravity center position of the subject area as the feature position.
- Claim:
11. The line-of-sight detection apparatus according to claim 7 , wherein, in a case where a plurality of feature positions are detected, the correction value determination unit selects any of the plurality of feature positions as a feature position, which the position of the line of sight corrected by the line-of-sight position correction unit is caused to match, according to a priority of each of the plurality of feature positions.
- Claim:
12. The line-of-sight detection apparatus according to claim 11 , wherein the priority of each of the plurality of feature positions is changed according to a relative size of a subject area with respect to an angle of view in the image.
- Claim:
13. The line-of-sight detection apparatus according to claim 11 , wherein the priority of each of the plurality of feature positions is changed according to contrast of the image.
- Claim:
14. The line-of-sight detection apparatus according to claim 7 , wherein the correction value determination unit determines the correction value such that, in a case where a plurality of feature positions of the detected subject are detected, the position of the line of sight corrected by the line-of-sight position correction unit matches any of the plurality of feature positions, and the correction value determination unit determines the correction value such that, after a lapse of a predetermined time period, in a case where a degree of matching between the position of the line of sight corrected by the line-of-sight position correction unit and the any of the plurality of feature positions is less than a predetermined threshold value, the position of the line of sight corrected by the line-of-sight position correction unit matches a feature position which is different from the any of the plurality of feature positions, among the plurality of the feature positions.
- Claim:
15. The line-of-sight detection apparatus according to claim 7 , wherein the correction value determination unit determines the correction value such that the position of the line of sight corrected by the line-of-sight position correction unit matches a feature position of a subject which the user tends to watch.
- Claim:
16. The line-of-sight detection apparatus according to claim 1 , wherein the correction value determination unit determines the correction value such that, in a case where a time period in which the position of the line of sight of the user corrected by the line-of-sight position correction unit and the first subject detected by the subject detection unit continuously overlap each other is less than a predetermined time period, the position of the line of sight corrected by the line-of-sight position correction unit matches a position of another subject detected by the subject detection unit.
- Claim:
17. The line-of-sight detection apparatus according to claim 1 , wherein the display unit displays, in the image, a mark indicative of the position of the line of sight of the user corrected by the line-of-sight position correction unit.
- Claim:
18. The line-of-sight detection apparatus according to claim 1 , wherein the display unit displays, in the image, a mark indicative of a position of the subject detected by the subject detection unit.
- Claim:
19. The line-of-sight detection apparatus according to claim 17 , wherein the display unit is an electronic display viewfinder which allows contact of an eye part of the user and displays the mark.
- Claim:
20. An imaging apparatus comprising: an imaging unit; and the line-of-sight detection apparatus according to claim 1 , wherein the line-of-sight detection apparatus performs control such that the image captured by the imaging unit is displayed in the display unit, and corrects a line of sight of an eye which looks at the image.
- Claim:
21. A line-of-sight detection method comprising: detecting a position of a line of sight of a user with respect to a display unit; detecting one or more subjects from an image displayed in the display unit; determining a correction value such that the position of the line of sight matches a position of one of the one or more subjects, wherein, in a case where the one or more subjects include a plurality of subjects, the position of the line of sight corrected by using the correction value matches a first subject of the plurality of subjects, and wherein, in a case where a degree of matching between the position of the line of sight corrected by the correction value and the first subject does not satisfy a predetermined condition, the position of the line of sight corrected by using the correction value matches a subject which is different from the first subject, among the plurality of the subjects; and correcting the position of the line of sight by using the correction value.
- Claim:
22. A non-transitory computer-readable storage medium storing a program for causing a computer to function as: a line-of-sight detection unit configured to detect a position of a line of sight of a user with respect to a display unit; a line-of-sight position correction unit configured to correct the position of the line of sight detected by the line-of-sight detection unit by using a correction value; a subject detection unit configured to detect a subject from an image displayed in the display unit; and a correction value determination unit configured to determine the correction value used by the line-of-sight position correction unit such that the position of the line of sight corrected by the line-of-sight position correction unit matches a position of the subject detected by the subject detection unit, wherein the correction value determination unit determines the correction value such that, in a case where a plurality of subjects are detected, the position of the line of sight corrected by the line-of-sight position correction unit matches a first subject of the plurality of subjects, and wherein the correction value determination unit determines the correction value such that, in a case where a degree of matching between the position of the line of sight corrected by the line-of-sight position correction unit and the first subject does not satisfy a predetermined condition, the position of the line of sight corrected by the line-of-sight position correction unit matches a subject which is different from the first subject, among the plurality of subjects.
- Claim:
23. The line-of-sight detection apparatus according to claim 1 , wherein the correction value determination unit determines the correction value based on a difference between the position of the line of sight detected by the line-of-sight detection unit and the position of the subject detected by the subject detection unit.
- Patent References Cited:
10776989 September 2020 Douglas
20100128927 May 2010 Ikenoue
20160095511 April 2016 Taguchi
20180227481 August 2018 Kimura
2018-205648 December 2018
2020-106552 July 2020
- Primary Examiner:
Aggarwal, Yogesh K
- Attorney, Agent or Firm:
Canon U.S.A., Inc. IP Division
- الرقم المعرف:
edspgr.11930266
Processing Request
No Comments.